Nov 24 10:16:29 user nova-compute[75073]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75073) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 10:16:29 user nova-compute[75073]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75073) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 10:16:29 user nova-compute[75073]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75073) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 10:16:29 user nova-compute[75073]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 24 10:16:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:16:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:16:29 user nova-compute[75073]: INFO nova.virt.driver [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 24 10:16:30 user nova-compute[75073]: INFO nova.compute.provider_config [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Acquiring lock "singleton_lock" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Acquired lock "singleton_lock" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Releasing lock "singleton_lock" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Full set of CONF: {{(pid=75073) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ******************************************************************************** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Configuration options gathered from: {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ================================================================================ {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] allow_resize_to_same_host      = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] arq_binding_timeout            = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] backdoor_port                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] backdoor_socket                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] block_device_allocate_retries  = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] block_device_allocate_retries_interval = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cert                           = self.pem {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute_monitors               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] config_dir                     = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] config_drive_format            = iso9660 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] config_source                  = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] console_host                   = user {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] control_exchange               = nova {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cpu_allocation_ratio           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] daemon                         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] debug                          = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_access_ip_network_name = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_availability_zone      = nova {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_ephemeral_format       = ext4 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_green_pool_size        = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] default_schedule_zone          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] disk_allocation_ratio          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] enable_new_services            = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] enabled_ssl_apis               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] flat_injected                  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] force_config_drive             = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] force_raw_images               = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] graceful_shutdown_timeout      = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] heal_instance_info_cache_interval = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] host                           = user {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_build_timeout         = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_delete_interval       = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_name_template         = instance-%08x {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_usage_audit           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_usage_audit_period    = month {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] internal_service_availability_zone = internal {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] key                            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] live_migration_retry_count     = 30 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_config_append              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_dir                        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_file                       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_options                    = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_rotate_interval            = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_rotate_interval_type       = days {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] log_rotation_type              = none {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] long_rpc_timeout               = 1800 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_concurrent_builds          = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_concurrent_live_migrations = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_concurrent_snapshots       = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_local_block_devices        = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_logfile_count              = 30 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] max_logfile_size_mb            = 200 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] maximum_instance_delete_attempts = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metadata_listen                = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metadata_listen_port           = 8775 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metadata_workers               = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] migrate_max_retries            = -1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] mkisofs_cmd                    = genisoimage {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] my_ip                          = 10.0.0.210 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] network_allocate_retries       = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] osapi_compute_listen_port      = 8774 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] osapi_compute_unique_server_name_scope =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] osapi_compute_workers          = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] password_length                = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] periodic_enable                = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] periodic_fuzzy_delay           = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] pointer_model                  = ps2mouse {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] preallocate_images             = none {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] publish_errors                 = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] pybasedir                      = /opt/stack/nova {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ram_allocation_ratio           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rate_limit_burst               = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rate_limit_except_level        = CRITICAL {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rate_limit_interval            = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reboot_timeout                 = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reclaim_instance_interval      = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] record                         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reimage_timeout_per_gb         = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] report_interval                = 120 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rescue_timeout                 = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reserved_host_cpus             = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reserved_host_disk_mb          = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reserved_host_memory_mb        = 512 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] reserved_huge_pages            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] resize_confirm_window          = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] resize_fs_using_block_device   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] resume_guests_state_on_host_boot = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rpc_response_timeout           = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] run_external_periodic_tasks    = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] running_deleted_instance_action = reap {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] running_deleted_instance_timeout = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler_instance_sync_interval = 120 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_down_time              = 720 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] servicegroup_driver            = db {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] shelved_offload_time           = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] shelved_poll_interval          = 3600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] shutdown_timeout               = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] source_is_ipv6                 = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ssl_only                       = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] state_path                     = /opt/stack/data/nova {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] sync_power_state_interval      = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] sync_power_state_pool_size     = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] syslog_log_facility            = LOG_USER {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] tempdir                        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] timeout_nbd                    = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] transport_url                  = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] update_resources_interval      = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_cow_images                 = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_eventlog                   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_journal                    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_json                       = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_rootwrap_daemon            = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_stderr                     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] use_syslog                     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vcpu_pin_set                   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plugging_is_fatal          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plugging_timeout           = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] virt_mkfs                      = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] volume_usage_poll_interval     = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] watch_log_file                 = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] web                            = /usr/share/spice-html5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_concurrency.disable_process_locking = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.auth_strategy              = keystone {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.compute_link_prefix        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.dhcp_domain                = novalocal {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.enable_instance_password   = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.glance_link_prefix         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.instance_list_per_project_cells = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.list_records_by_skipping_down_cells = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.local_metadata_per_cell    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.max_limit                  = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.metadata_cache_expiration  = 15 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.neutron_default_tenant_id  = default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.use_forwarded_for          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.use_neutron_default_nets   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_dynamic_targets = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_jsonfile_path   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.backend_argument         = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.config_prefix            = cache.oslo {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.dead_timeout             = 60.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.debug_cache_backend      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.enable_retry_client      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.enable_socket_keepalive  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.enabled                  = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.expiration_time          = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.hashclient_retry_attempts = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_dead_retry      = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_password        =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_sasl_enabled    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.memcache_username        =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.proxies                  = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.retry_attempts           = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.retry_delay              = 0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.socket_keepalive_count   = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.socket_keepalive_idle    = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.socket_keepalive_interval = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.tls_allowed_ciphers      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.tls_cafile               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.tls_certfile             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.tls_enabled              = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cache.tls_keyfile              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.auth_section            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.auth_type               = password {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.cafile                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.certfile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.collect_timing          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.cross_az_attach         = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.debug                   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.endpoint_template       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.http_retries            = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.insecure                = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.keyfile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.os_region_name          = RegionOne {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.split_loggers           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cinder.timeout                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.cpu_dedicated_set      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.cpu_shared_set         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.image_type_exclude_list = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.resource_provider_association_refresh = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.shutdown_retry_interval = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] conductor.workers              = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] console.allowed_origins        = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] console.ssl_ciphers            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] console.ssl_minimum_version    = default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] consoleauth.token_ttl          = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.cafile                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.certfile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.collect_timing          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.connect_retries         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.connect_retry_delay     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.endpoint_override       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.insecure                = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.keyfile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.max_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.min_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.region_name             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.service_name            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.service_type            = accelerator {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.split_loggers           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.status_code_retries     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.timeout                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] cyborg.version                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.backend               = sqlalchemy {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.connection            = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.connection_debug      = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.connection_parameters =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.connection_recycle_time = 3600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.connection_trace      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.db_inc_retry_interval = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.db_max_retries        = 20 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.db_max_retry_interval = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.db_retry_interval     = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.max_overflow          = 50 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.max_pool_size         = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.max_retries           = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.mysql_wsrep_sync_wait = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.pool_timeout          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.retry_interval        = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.slave_connection      = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] database.sqlite_synchronous    = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.backend           = sqlalchemy {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.connection        = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.connection_debug  = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.connection_parameters =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.connection_recycle_time = 3600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.connection_trace  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.db_inc_retry_interval = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.db_max_retries    = 20 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.db_max_retry_interval = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.db_retry_interval = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.max_overflow      = 50 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.max_pool_size     = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.max_retries       = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.pool_timeout      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.retry_interval    = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.slave_connection  = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] api_database.sqlite_synchronous = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] devices.enabled_mdev_types     = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ephemeral_storage_encryption.enabled = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.api_servers             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.cafile                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.certfile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.collect_timing          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.connect_retries         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.connect_retry_delay     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.debug                   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.default_trusted_certificate_ids = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.enable_certificate_validation = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.enable_rbd_download     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.endpoint_override       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.insecure                = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.keyfile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.max_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.min_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.num_retries             = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.rbd_ceph_conf           =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.rbd_connect_timeout     = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.rbd_pool                =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.rbd_user                =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.region_name             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.service_name            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.service_type            = image {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.split_loggers           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.status_code_retries     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.timeout                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.verify_glance_signatures = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] glance.version                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] guestfs.debug                  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.config_drive_cdrom      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.config_drive_inject_password = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.enable_remotefx         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.instances_path_share    =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.limit_cpu_features      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.use_multipath_io        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.vswitch_name            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] mks.enabled                    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.manager_interval   = 2400 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.precache_concurrency = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.remove_unused_base_images = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] image_cache.subdirectory_name  = _base {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.api_max_retries         = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.api_retry_interval      = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.auth_section            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.auth_type               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.cafile                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.certfile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.collect_timing          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.conductor_group         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.connect_retries         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.connect_retry_delay     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.endpoint_override       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.insecure                = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.keyfile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.max_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.min_version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.peer_list               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.region_name             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.serial_console_state_timeout = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.service_name            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.service_type            = baremetal {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.split_loggers           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.status_code_retries     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.timeout                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ironic.version                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] key_manager.fixed_key          = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.barbican_api_version  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.barbican_endpoint     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.barbican_endpoint_type = public {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.barbican_region_name  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.cafile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.certfile              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.collect_timing        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.insecure              = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.keyfile               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.number_of_retries     = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.retry_delay           = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.send_service_user_token = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.split_loggers         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.timeout               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.verify_ssl            = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican.verify_ssl_path       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.auth_section = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.auth_type = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.cafile   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.certfile = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.collect_timing = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.insecure = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.keyfile  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.split_loggers = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] barbican_service_user.timeout  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.approle_role_id          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.approle_secret_id        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.cafile                   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.certfile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.collect_timing           = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.insecure                 = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.keyfile                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.kv_mountpoint            = secret {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.kv_path                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.kv_version               = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.namespace                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.root_token_id            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.split_loggers            = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.ssl_ca_crt_file          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.timeout                  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.use_ssl                  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.auth_section          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.auth_type             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.cafile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.certfile              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.collect_timing        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.connect_retries       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.connect_retry_delay   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.endpoint_override     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.insecure              = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.keyfile               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.max_version           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.min_version           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.region_name           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.service_name          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.service_type          = identity {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.split_loggers         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.status_code_retries   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.timeout               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] keystone.version               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.connection_uri         =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_mode               = custom {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: WARNING oslo_config.cfg [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_power_governor_high = performance {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_power_management   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.device_detach_attempts = 8 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.device_detach_timeout  = 20 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.disk_cachemodes        = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.disk_prefix            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.enabled_perf_events    = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.file_backed_memory     = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.gid_maps               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.hw_disk_discard        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.hw_machine_type        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_rbd_pool        = rbd {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_type            = default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.images_volume_group    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.inject_key             = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.inject_partition       = -2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.inject_password        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.iscsi_iface            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.iser_use_multipath     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_downtime = 500 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_inbound_addr = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_scheme  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_timeout_action = abort {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_tunnelled = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: WARNING oslo_config.cfg [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 24 10:16:30 user nova-compute[75073]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 24 10:16:30 user nova-compute[75073]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 24 10:16:30 user nova-compute[75073]: and ``live_migration_inbound_addr`` respectively.
Nov 24 10:16:30 user nova-compute[75073]: ).  Its value may be silently ignored in the future.
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.live_migration_with_native_tls = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.max_queues             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.nfs_mount_options      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_pcie_ports         = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.pmem_namespaces        = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.quobyte_client_cfg     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rbd_secret_uuid        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rbd_user               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rescue_image_id        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rescue_kernel_id       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.rx_queue_size          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.smbfs_mount_options    =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.snapshot_compression   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.snapshot_image_format  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.sparse_logical_volumes = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.swtpm_enabled          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.swtpm_group            = tss {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.swtpm_user             = tss {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.sysinfo_serial         = unique {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.tb_cache_size          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.tx_queue_size          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.uid_maps               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.use_virtio_for_bridges = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.virt_type              = kvm {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.volume_clear           = zero {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.volume_clear_size      = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.volume_use_multipath   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_cache_path   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.auth_section           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.auth_type              = password {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.cafile                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.certfile               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.collect_timing         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.connect_retries        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.connect_retry_delay    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.default_floating_pool  = public {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.endpoint_override      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.extension_sync_interval = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.http_retries           = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.insecure               = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.keyfile                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.max_version            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.min_version            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.ovs_bridge             = br-int {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.physnets               = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.region_name            = RegionOne {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.service_metadata_proxy = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.service_name           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.service_type           = network {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.split_loggers          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.status_code_retries    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.timeout                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] neutron.version                = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] notifications.bdms_in_notifications = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] notifications.default_level    = INFO {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] notifications.notification_format = unversioned {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] notifications.notify_on_state_change = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] pci.alias                      = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] pci.device_spec                = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] pci.report_in_placement        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.auth_section         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.auth_type            = password {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.cafile               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.certfile             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.collect_timing       = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.connect_retries      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.connect_retry_delay  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.default_domain_id    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.default_domain_name  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.domain_id            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.domain_name          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.endpoint_override    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.insecure             = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.keyfile              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.max_version          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.min_version          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.password             = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.project_domain_id    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.project_domain_name  = Default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.project_id           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.project_name         = service {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.region_name          = RegionOne {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.service_name         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.service_type         = placement {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.split_loggers        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.status_code_retries  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.system_scope         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.timeout              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.trust_id             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.user_domain_id       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.user_domain_name     = Default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.user_id              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.username             = placement {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] placement.version              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.cores                    = 20 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.count_usage_from_placement = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.injected_file_content_bytes = 10240 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.injected_file_path_length = 255 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.injected_files           = 5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.instances                = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.key_pairs                = 100 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.metadata_items           = 128 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.ram                      = 51200 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.recheck_quota            = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.server_group_members     = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] quota.server_groups            = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rdp.enabled                    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.image_metadata_prefilter = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.max_attempts         = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.max_placement_results = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] scheduler.workers              = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.host_subset_size = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.isolated_hosts = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.isolated_images = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.pci_in_placement = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.track_instance_changes = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metrics.required               = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metrics.weight_multiplier      = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] metrics.weight_setting         = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.enabled         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.port_range      = 10000:20000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] serial_console.serialproxy_port = 6083 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.auth_section      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.auth_type         = password {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.cafile            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.certfile          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.collect_timing    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.insecure          = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.keyfile           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.send_service_user_token = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.split_loggers     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] service_user.timeout           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.agent_enabled            = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.enabled                  = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.html5proxy_port          = 6082 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.image_compression        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.jpeg_compression         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.playback_compression     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.server_listen            = 127.0.0.1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.streaming_mode           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] spice.zlib_compression         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] upgrade_levels.baseapi         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] upgrade_levels.compute         = auto {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] upgrade_levels.conductor       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] upgrade_levels.scheduler       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.cafile = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.certfile = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.insecure = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vendordata_dynamic_auth.timeout = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.api_retry_count         = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.ca_file                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.cache_prefix            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.cluster_name            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.connection_pool_size    = 10 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.console_delay_seconds   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.datastore_regex         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.host_ip                 = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.host_password           = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.host_port               = 443 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.host_username           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.insecure                = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.integration_bridge      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.maximum_objects         = 100 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.pbm_default_policy      = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.pbm_enabled             = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.pbm_wsdl_location       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.serial_port_proxy_uri   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.serial_port_service_uri = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.task_poll_interval      = 0.5 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.use_linked_clone        = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.vnc_keymap              = en-us {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.vnc_port                = 5900 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vmware.vnc_port_total          = 10000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.auth_schemes               = ['none'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.enabled                    = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.novncproxy_port            = 6080 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.vencrypt_ca_certs          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.vencrypt_client_cert       = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vnc.vencrypt_client_key        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.disable_rootwrap   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.enable_numa_live_migration = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.libvirt_disable_apic = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.client_socket_timeout     = 900 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.default_pool_size         = 1000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.keep_alive                = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.max_header_line           = 16384 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.ssl_ca_file               = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.ssl_cert_file             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.ssl_key_file              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.tcp_keepidle              = 600 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] zvm.ca_file                    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] zvm.cloud_connector_url        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] zvm.reachable_timeout          = 300 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.enforce_new_defaults = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.enforce_scope      = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.policy_default_rule = default {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.connection_string     = messaging:// {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.enabled               = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.es_doc_type           = notification {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.es_scroll_size        = 10000 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.es_scroll_time        = 2m {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.filter_error_trace    = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.hmac_keys             = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.sentinel_service_name = mymaster {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.socket_timeout        = 0.1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.trace_requests        = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler.trace_sqlalchemy      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler_jaeger.process_tags   = {} {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler_jaeger.service_name_prefix = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] profiler_otlp.service_name_prefix = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] remote_debug.host              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] remote_debug.port              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_notifications.retry = -1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.auth_section        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.auth_type           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.cafile              = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.certfile            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.collect_timing      = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.connect_retries     = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.connect_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.endpoint_id         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.endpoint_override   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.insecure            = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.keyfile             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.max_version         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.min_version         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.region_name         = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.service_name        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.service_type        = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.split_loggers       = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.status_code_retries = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.status_code_retry_delay = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.timeout             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.valid_interfaces    = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_limit.version             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_reports.file_event_handler = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] oslo_reports.log_dir           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.group  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] vif_plug_ovs_privileged.user   = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.isolate_vif         = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] os_brick.lock_path             = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.capabilities   = [21] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.group          = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.helper_command = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] privsep_osbrick.user           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.group           = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.helper_command  = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] nova_sys_admin.user            = None {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG oslo_service.service [None req-695a1509-4c83-4b59-af94-3e126d0c2828 None None] ******************************************************************************** {{(pid=75073) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 24 10:16:30 user nova-compute[75073]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Connecting to libvirt: qemu:///system {{(pid=75073) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb2417e2380> {{(pid=75073) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 24 10:16:30 user nova-compute[75073]: libvirt:  error : internal error: could not initialize domain event timer
Nov 24 10:16:30 user nova-compute[75073]: WARNING nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb2417e2380> {{(pid=75073) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Starting native event thread {{(pid=75073) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Starting green dispatch thread {{(pid=75073) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Starting connection event dispatch thread {{(pid=75073) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 24 10:16:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Connection event '1' reason 'None'
Nov 24 10:16:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 24 10:16:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.mount [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Initialising _HostMountState generation 0 {{(pid=75073) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 24 10:16:37 user nova-compute[75073]: INFO nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host capabilities <capabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <host>
Nov 24 10:16:37 user nova-compute[75073]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 24 10:16:37 user nova-compute[75073]:     <cpu>
Nov 24 10:16:37 user nova-compute[75073]:       <arch>x86_64</arch>
Nov 24 10:16:37 user nova-compute[75073]:       <model>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <microcode version='1070'/>
Nov 24 10:16:37 user nova-compute[75073]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='osxsave'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='invtsc'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='rsba'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature name='skip-l1dfl-vmentry'/>
Nov 24 10:16:37 user nova-compute[75073]:       <pages unit='KiB' size='4'/>
Nov 24 10:16:37 user nova-compute[75073]:       <pages unit='KiB' size='2048'/>
Nov 24 10:16:37 user nova-compute[75073]:     </cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <power_management>
Nov 24 10:16:37 user nova-compute[75073]:       <suspend_mem/>
Nov 24 10:16:37 user nova-compute[75073]:       <suspend_disk/>
Nov 24 10:16:37 user nova-compute[75073]:       <suspend_hybrid/>
Nov 24 10:16:37 user nova-compute[75073]:     </power_management>
Nov 24 10:16:37 user nova-compute[75073]:     <iommu support='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <migration_features>
Nov 24 10:16:37 user nova-compute[75073]:       <live/>
Nov 24 10:16:37 user nova-compute[75073]:       <uri_transports>
Nov 24 10:16:37 user nova-compute[75073]:         <uri_transport>tcp</uri_transport>
Nov 24 10:16:37 user nova-compute[75073]:         <uri_transport>rdma</uri_transport>
Nov 24 10:16:37 user nova-compute[75073]:       </uri_transports>
Nov 24 10:16:37 user nova-compute[75073]:     </migration_features>
Nov 24 10:16:37 user nova-compute[75073]:     <topology>
Nov 24 10:16:37 user nova-compute[75073]:       <cells num='2'>
Nov 24 10:16:37 user nova-compute[75073]:         <cell id='0'>
Nov 24 10:16:37 user nova-compute[75073]:           <memory unit='KiB'>8189224</memory>
Nov 24 10:16:37 user nova-compute[75073]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 24 10:16:37 user nova-compute[75073]:           <pages unit='KiB' size='2048'>0</pages>
Nov 24 10:16:37 user nova-compute[75073]:           <distances>
Nov 24 10:16:37 user nova-compute[75073]:             <sibling id='0' value='10'/>
Nov 24 10:16:37 user nova-compute[75073]:             <sibling id='1' value='20'/>
Nov 24 10:16:37 user nova-compute[75073]:           </distances>
Nov 24 10:16:37 user nova-compute[75073]:           <cpus num='6'>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 24 10:16:37 user nova-compute[75073]:           </cpus>
Nov 24 10:16:37 user nova-compute[75073]:         </cell>
Nov 24 10:16:37 user nova-compute[75073]:         <cell id='1'>
Nov 24 10:16:37 user nova-compute[75073]:           <memory unit='KiB'>8206460</memory>
Nov 24 10:16:37 user nova-compute[75073]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 24 10:16:37 user nova-compute[75073]:           <pages unit='KiB' size='2048'>0</pages>
Nov 24 10:16:37 user nova-compute[75073]:           <distances>
Nov 24 10:16:37 user nova-compute[75073]:             <sibling id='0' value='20'/>
Nov 24 10:16:37 user nova-compute[75073]:             <sibling id='1' value='10'/>
Nov 24 10:16:37 user nova-compute[75073]:           </distances>
Nov 24 10:16:37 user nova-compute[75073]:           <cpus num='6'>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 24 10:16:37 user nova-compute[75073]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 24 10:16:37 user nova-compute[75073]:           </cpus>
Nov 24 10:16:37 user nova-compute[75073]:         </cell>
Nov 24 10:16:37 user nova-compute[75073]:       </cells>
Nov 24 10:16:37 user nova-compute[75073]:     </topology>
Nov 24 10:16:37 user nova-compute[75073]:     <cache>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 24 10:16:37 user nova-compute[75073]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 24 10:16:37 user nova-compute[75073]:     </cache>
Nov 24 10:16:37 user nova-compute[75073]:     <secmodel>
Nov 24 10:16:37 user nova-compute[75073]:       <model>apparmor</model>
Nov 24 10:16:37 user nova-compute[75073]:       <doi>0</doi>
Nov 24 10:16:37 user nova-compute[75073]:     </secmodel>
Nov 24 10:16:37 user nova-compute[75073]:     <secmodel>
Nov 24 10:16:37 user nova-compute[75073]:       <model>dac</model>
Nov 24 10:16:37 user nova-compute[75073]:       <doi>0</doi>
Nov 24 10:16:37 user nova-compute[75073]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 24 10:16:37 user nova-compute[75073]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 24 10:16:37 user nova-compute[75073]:     </secmodel>
Nov 24 10:16:37 user nova-compute[75073]:   </host>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='alpha'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>clipper</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='armv6l'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>spitz</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>nuri</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>kzm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>z2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>tosa</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n810</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>terrier</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>midway</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>microbit</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>verdex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>highbank</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>akita</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>connex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>collie</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='armv7l'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>spitz</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>nuri</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>kzm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>z2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>tosa</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n810</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>terrier</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>midway</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>microbit</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>verdex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>highbank</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>akita</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>connex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>collie</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='aarch64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>spitz</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>nuri</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>kzm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>z2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>tosa</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n810</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>n800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>terrier</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>midway</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>microbit</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>verdex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>raspi3b</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>highbank</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>akita</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>connex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>collie</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <acpi default='on' toggle='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='cris'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='i686'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>x-remote</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>isapc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>microvm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='kvm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <pae/>
Nov 24 10:16:37 user nova-compute[75073]:       <nonpae/>
Nov 24 10:16:37 user nova-compute[75073]:       <acpi default='on' toggle='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:       <apic default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='m68k'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>an5206</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>q800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>next-cube</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='microblaze'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='microblazeel'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='mips'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>malta</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='mipsel'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>malta</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='mips64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>malta</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>pica61</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>magnum</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='mips64el'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>malta</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>pica61</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>magnum</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='16'>boston</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='ppc'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mac99</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>40p</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>taihu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='ppc64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>taihu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>40p</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mac99</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='ppc64le'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>taihu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>40p</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>mac99</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2048'>powernv8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='riscv32'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='8'>spike</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>opentitan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='5'>sifive_u</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sifive_e</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='8'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='riscv64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='8'>spike</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='5'>sifive_u</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>shakti_c</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sifive_e</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='8'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='s390x'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='sh4'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>shix</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>r2d</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='sh4eb'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>shix</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>r2d</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='sparc'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>SS-5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>SS-20</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>LX</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>SS-4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>SS-10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>Voyager</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='sparc64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sun4u</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>niagara</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>sun4v</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='x86_64'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>64</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>x-remote</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='1'>isapc</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>microvm</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='kvm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <acpi default='on' toggle='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:       <apic default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='xtensa'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>sim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>kc705</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ml605</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx200</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx60</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]:   <guest>
Nov 24 10:16:37 user nova-compute[75073]:     <os_type>hvm</os_type>
Nov 24 10:16:37 user nova-compute[75073]:     <arch name='xtensaeb'>
Nov 24 10:16:37 user nova-compute[75073]:       <wordsize>32</wordsize>
Nov 24 10:16:37 user nova-compute[75073]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='4'>sim</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>kc705</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ml605</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>virt</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx200</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>lx60</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 24 10:16:37 user nova-compute[75073]:       <domain type='qemu'/>
Nov 24 10:16:37 user nova-compute[75073]:     </arch>
Nov 24 10:16:37 user nova-compute[75073]:     <features>
Nov 24 10:16:37 user nova-compute[75073]:       <cpuselection/>
Nov 24 10:16:37 user nova-compute[75073]:       <deviceboot/>
Nov 24 10:16:37 user nova-compute[75073]:       <disksnapshot default='on' toggle='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     </features>
Nov 24 10:16:37 user nova-compute[75073]:   </guest>
Nov 24 10:16:37 user nova-compute[75073]: </capabilities>
Nov 24 10:16:37 user nova-compute[75073]: 
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-q35-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>i686</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='288'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'/>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='lm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-i440fx-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>i686</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='255'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'/>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='lm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ide</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-q35-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>i686</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='288'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'/>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='lm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-i440fx-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>i686</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='255'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'/>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='lm'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ide</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-q35-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>x86_64</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='288'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>efi</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='invtsc'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='rsba'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-i440fx-6.2</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>x86_64</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='255'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>efi</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='invtsc'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='rsba'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ide</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-q35-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>x86_64</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='288'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>efi</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='invtsc'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='rsba'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 24 10:16:37 user nova-compute[75073]: <domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 10:16:37 user nova-compute[75073]:   <domain>kvm</domain>
Nov 24 10:16:37 user nova-compute[75073]:   <machine>pc-i440fx-jammy</machine>
Nov 24 10:16:37 user nova-compute[75073]:   <arch>x86_64</arch>
Nov 24 10:16:37 user nova-compute[75073]:   <vcpu max='255'/>
Nov 24 10:16:37 user nova-compute[75073]:   <iothreads supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:   <os supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='firmware'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>efi</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:     <loader supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>rom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pflash</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='readonly'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>yes</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='secure'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>no</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </loader>
Nov 24 10:16:37 user nova-compute[75073]:   </os>
Nov 24 10:16:37 user nova-compute[75073]:   <cpu>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-passthrough' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='hostPassthroughMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='maximum' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='maximumMigratable'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>on</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>off</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='host-model' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <vendor>Intel</vendor>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ss'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='vmx'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pcid'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='hypervisor'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arat'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='umip'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='md-clear'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='invtsc'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibpb'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='ibrs'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-stibp'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='rsba'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='erms'/>
Nov 24 10:16:37 user nova-compute[75073]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:     <mode name='custom' supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>qemu64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>qemu32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>phenom</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>pentium</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>n270</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm64</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>kvm32</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>coreduo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>core2duo</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>athlon</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Westmere</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Snowridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Skylake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>SandyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Penryn</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G5</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G4</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G3</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Opteron_G2</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Opteron_G1</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>IvyBridge</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Icelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Haswell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Rome</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-Milan</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>EPYC</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Dhyana</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cooperlake</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>Conroe</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='no'>Broadwell</model>
Nov 24 10:16:37 user nova-compute[75073]:       <model usable='yes'>486</model>
Nov 24 10:16:37 user nova-compute[75073]:     </mode>
Nov 24 10:16:37 user nova-compute[75073]:   </cpu>
Nov 24 10:16:37 user nova-compute[75073]:   <memoryBacking supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:     <enum name='sourceType'>
Nov 24 10:16:37 user nova-compute[75073]:       <value>file</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>anonymous</value>
Nov 24 10:16:37 user nova-compute[75073]:       <value>memfd</value>
Nov 24 10:16:37 user nova-compute[75073]:     </enum>
Nov 24 10:16:37 user nova-compute[75073]:   </memoryBacking>
Nov 24 10:16:37 user nova-compute[75073]:   <devices>
Nov 24 10:16:37 user nova-compute[75073]:     <disk supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='diskDevice'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>disk</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cdrom</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>floppy</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>lun</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='bus'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ide</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>fdc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sata</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </disk>
Nov 24 10:16:37 user nova-compute[75073]:     <graphics supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='type'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>sdl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vnc</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>spice</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egl-headless</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </graphics>
Nov 24 10:16:37 user nova-compute[75073]:     <video supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='modelType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>cirrus</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>vmvga</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>qxl</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>none</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>bochs</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>ramfb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </video>
Nov 24 10:16:37 user nova-compute[75073]:     <hostdev supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='mode'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>subsystem</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='startupPolicy'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>default</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>mandatory</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>requisite</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>optional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='subsysType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>usb</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>pci</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>scsi</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='capsType'/>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='pciBackend'/>
Nov 24 10:16:37 user nova-compute[75073]:     </hostdev>
Nov 24 10:16:37 user nova-compute[75073]:     <rng supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtio-non-transitional</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>random</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>egd</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>builtin</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </rng>
Nov 24 10:16:37 user nova-compute[75073]:     <filesystem supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='driverType'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>path</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>handle</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>virtiofs</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </filesystem>
Nov 24 10:16:37 user nova-compute[75073]:     <tpm supported='yes'>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='model'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-tis</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>tpm-crb</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:       <enum name='backendModel'>
Nov 24 10:16:37 user nova-compute[75073]:         <value>passthrough</value>
Nov 24 10:16:37 user nova-compute[75073]:         <value>emulator</value>
Nov 24 10:16:37 user nova-compute[75073]:       </enum>
Nov 24 10:16:37 user nova-compute[75073]:     </tpm>
Nov 24 10:16:37 user nova-compute[75073]:   </devices>
Nov 24 10:16:37 user nova-compute[75073]:   <features>
Nov 24 10:16:37 user nova-compute[75073]:     <gic supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:     <vmcoreinfo supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <genid supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backingStoreInput supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <backup supported='yes'/>
Nov 24 10:16:37 user nova-compute[75073]:     <sev supported='no'/>
Nov 24 10:16:37 user nova-compute[75073]:   </features>
Nov 24 10:16:37 user nova-compute[75073]: </domainCapabilities>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75073) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75073) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Checking secure boot support for host arch (x86_64) {{(pid=75073) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 24 10:16:37 user nova-compute[75073]: INFO nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Secure Boot support detected
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] cpu compare xml: <cpu match="exact">
Nov 24 10:16:37 user nova-compute[75073]:   <model>Nehalem</model>
Nov 24 10:16:37 user nova-compute[75073]: </cpu>
Nov 24 10:16:37 user nova-compute[75073]:  {{(pid=75073) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 24 10:16:37 user nova-compute[75073]: INFO nova.virt.node [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Generated node identity b8421a5b-83de-4630-bf28-983e95daab87
Nov 24 10:16:37 user nova-compute[75073]: INFO nova.virt.node [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Wrote node identity b8421a5b-83de-4630-bf28-983e95daab87 to /opt/stack/data/nova/compute_id
Nov 24 10:16:37 user nova-compute[75073]: WARNING nova.compute.manager [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Compute nodes ['b8421a5b-83de-4630-bf28-983e95daab87'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 24 10:16:37 user nova-compute[75073]: INFO nova.compute.manager [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 24 10:16:37 user nova-compute[75073]: WARNING nova.compute.manager [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 24 10:16:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:16:37 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:16:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:16:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Hypervisor/Node resource view: name=user free_ram=10957MB free_disk=26.256423950195312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:16:38 user nova-compute[75073]: WARNING nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] No compute node record for user:b8421a5b-83de-4630-bf28-983e95daab87: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b8421a5b-83de-4630-bf28-983e95daab87 could not be found.
Nov 24 10:16:38 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Compute node record created for user:user with uuid: b8421a5b-83de-4630-bf28-983e95daab87
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:16:38 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] [req-75e3a284-1621-40c4-af44-e4b0518c4128] Created resource provider record via placement API for resource provider with UUID b8421a5b-83de-4630-bf28-983e95daab87 and name user.
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75073) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 24 10:16:38 user nova-compute[75073]: INFO nova.virt.libvirt.host [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] kernel doesn't support AMD SEV
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Libvirt baseline CPU <cpu>
Nov 24 10:16:38 user nova-compute[75073]:   <arch>x86_64</arch>
Nov 24 10:16:38 user nova-compute[75073]:   <model>Nehalem</model>
Nov 24 10:16:38 user nova-compute[75073]:   <vendor>Intel</vendor>
Nov 24 10:16:38 user nova-compute[75073]:   <topology sockets="6" cores="1" threads="1"/>
Nov 24 10:16:38 user nova-compute[75073]: </cpu>
Nov 24 10:16:38 user nova-compute[75073]:  {{(pid=75073) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Updated inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Updating resource provider b8421a5b-83de-4630-bf28-983e95daab87 generation from 0 to 1 during operation: update_inventory {{(pid=75073) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Updating resource provider b8421a5b-83de-4630-bf28-983e95daab87 generation from 1 to 2 during operation: update_traits {{(pid=75073) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.service [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Creating RPC server for service compute {{(pid=75073) start /opt/stack/nova/nova/service.py:182}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.service [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] Join ServiceGroup membership for this service compute {{(pid=75073) start /opt/stack/nova/nova/service.py:199}}
Nov 24 10:16:38 user nova-compute[75073]: DEBUG nova.servicegroup.drivers.db [None req-685f835e-33c7-40ec-b238-53e2600a5571 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75073) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:17:35 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:17:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:17:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=10331MB free_disk=26.160049438476562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:17:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:18:30 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:18:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:18:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=10333MB free_disk=26.224708557128906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:18:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:18:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:18:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:19:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:19:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:19:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:19:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:19:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:19:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:19:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=10340MB free_disk=25.977001190185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:19:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:19:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:19:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:19:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:20:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:20:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:20:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:20:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9618MB free_disk=25.99715805053711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:20:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:43 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:20:43 user nova-compute[75073]: INFO nova.compute.claims [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Claim successful on node user
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:20:44 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:20:44 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Creating image(s)
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.policy [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22b4e168f7a8473d8664e9225c867318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d3f3f3d5494608acae0f64a9bf8e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.virt.images [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] 095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.part /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:20:45 user nova-compute[75073]: INFO nova.compute.claims [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Claim successful on node user
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.part /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.converted" returned: 0 in 0.330s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.426s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:45 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmix6rrmm/privsep.sock']
Nov 24 10:20:46 user sudo[84359]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmix6rrmm/privsep.sock
Nov 24 10:20:46 user sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 10:20:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:20:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:20:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Creating image(s)
Nov 24 10:20:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:46 user nova-compute[75073]: DEBUG nova.policy [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22b4e168f7a8473d8664e9225c867318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d3f3f3d5494608acae0f64a9bf8e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:20:47 user sudo[84359]: pam_unix(sudo:session): session closed for user root
Nov 24 10:20:47 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Spawned new privsep daemon via rootwrap
Nov 24 10:20:47 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 10:20:47 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 10:20:47 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 24 10:20:47 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84373
Nov 24 10:20:47 user nova-compute[75073]: WARNING oslo_privsep.priv_context [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] privsep daemon already running
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.161s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.210s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.210s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk 1073741824" returned: 0 in 0.047s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.206s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.157s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.217s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Successfully created port: 86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk 1073741824" returned: 0 in 0.074s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Cannot resize image /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Ensure instance console log exists: /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Cannot resize image /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Ensure instance console log exists: /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:20:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:20:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Successfully created port: f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Successfully updated port: 86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-changed-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Refreshing instance network info cache due to event network-changed-86f2db00-09e3-4054-a321-99883e964598. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:20:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Successfully updated port: f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance network_info: |[{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Refreshing network info cache for port 86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start _get_guest_xml network_info=[{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:20:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1200068686',display_name='tempest-ServerRescueNegativeTestJSON-server-1200068686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1200068686',id=1,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-dap0tq8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:20:44Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=368baad5-b756-4ae5-aa18-9d148632523d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.objects.instance [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:20:52 user nova-compute[75073]:   <uuid>368baad5-b756-4ae5-aa18-9d148632523d</uuid>
Nov 24 10:20:52 user nova-compute[75073]:   <name>instance-00000001</name>
Nov 24 10:20:52 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:20:52 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:20:52 user nova-compute[75073]:   <metadata>
Nov 24 10:20:52 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:20:52 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1200068686</nova:name>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:20:52</nova:creationTime>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:20:52 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:20:52 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:owner>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:20:52 user nova-compute[75073]:       </nova:owner>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:20:52 user nova-compute[75073]:       <nova:ports>
Nov 24 10:20:52 user nova-compute[75073]:         <nova:port uuid="86f2db00-09e3-4054-a321-99883e964598">
Nov 24 10:20:52 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:20:52 user nova-compute[75073]:         </nova:port>
Nov 24 10:20:52 user nova-compute[75073]:       </nova:ports>
Nov 24 10:20:52 user nova-compute[75073]:     </nova:instance>
Nov 24 10:20:52 user nova-compute[75073]:   </metadata>
Nov 24 10:20:52 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:20:52 user nova-compute[75073]:     <system>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="serial">368baad5-b756-4ae5-aa18-9d148632523d</entry>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="uuid">368baad5-b756-4ae5-aa18-9d148632523d</entry>
Nov 24 10:20:52 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:20:52 user nova-compute[75073]:     </system>
Nov 24 10:20:52 user nova-compute[75073]:   </sysinfo>
Nov 24 10:20:52 user nova-compute[75073]:   <os>
Nov 24 10:20:52 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:20:52 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:20:52 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:20:52 user nova-compute[75073]:   </os>
Nov 24 10:20:52 user nova-compute[75073]:   <features>
Nov 24 10:20:52 user nova-compute[75073]:     <acpi/>
Nov 24 10:20:52 user nova-compute[75073]:     <apic/>
Nov 24 10:20:52 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:20:52 user nova-compute[75073]:   </features>
Nov 24 10:20:52 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:20:52 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:20:52 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:20:52 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:20:52 user nova-compute[75073]:   </clock>
Nov 24 10:20:52 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:20:52 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:20:52 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:20:52 user nova-compute[75073]:   </cpu>
Nov 24 10:20:52 user nova-compute[75073]:   <devices>
Nov 24 10:20:52 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:20:52 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:20:52 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk"/>
Nov 24 10:20:52 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:20:52 user nova-compute[75073]:     </disk>
Nov 24 10:20:52 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:20:52 user nova-compute[75073]:       <mac address="fa:16:3e:23:11:5a"/>
Nov 24 10:20:52 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:20:52 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:20:52 user nova-compute[75073]:       <target dev="tap86f2db00-09"/>
Nov 24 10:20:52 user nova-compute[75073]:     </interface>
Nov 24 10:20:52 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:20:52 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/console.log" append="off"/>
Nov 24 10:20:52 user nova-compute[75073]:     </serial>
Nov 24 10:20:52 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:20:52 user nova-compute[75073]:     <video>
Nov 24 10:20:52 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:20:52 user nova-compute[75073]:     </video>
Nov 24 10:20:52 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:20:52 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:20:52 user nova-compute[75073]:     </rng>
Nov 24 10:20:52 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:20:52 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:20:52 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:20:52 user nova-compute[75073]:     </memballoon>
Nov 24 10:20:52 user nova-compute[75073]:   </devices>
Nov 24 10:20:52 user nova-compute[75073]: </domain>
Nov 24 10:20:52 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1200068686',display_name='tempest-ServerRescueNegativeTestJSON-server-1200068686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1200068686',id=1,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-dap0tq8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:20:44Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=368baad5-b756-4ae5-aa18-9d148632523d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG os_vif [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Created schema index Interface.name {{(pid=75073) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Created schema index Port.name {{(pid=75073) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Created schema index Bridge.name {{(pid=75073) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [POLLOUT] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b98695c6-2e27-5578-9238-6a5d6ac1415d', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:20:52 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpea1ew95v/privsep.sock']
Nov 24 10:20:52 user sudo[84414]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpea1ew95v/privsep.sock
Nov 24 10:20:52 user sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance network_info: |[{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start _get_guest_xml network_info=[{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:20:53 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:53 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-702734092',display_name='tempest-ServerRescueNegativeTestJSON-server-702734092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-702734092',id=2,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-76dwo0cl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:20:46Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=ccb126e6-2e9f-400e-9351-8183056a5410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:20:53 user nova-compute[75073]:   <uuid>ccb126e6-2e9f-400e-9351-8183056a5410</uuid>
Nov 24 10:20:53 user nova-compute[75073]:   <name>instance-00000002</name>
Nov 24 10:20:53 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:20:53 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:20:53 user nova-compute[75073]:   <metadata>
Nov 24 10:20:53 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:20:53 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-702734092</nova:name>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:20:53</nova:creationTime>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:20:53 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:20:53 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:owner>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:20:53 user nova-compute[75073]:       </nova:owner>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:20:53 user nova-compute[75073]:       <nova:ports>
Nov 24 10:20:53 user nova-compute[75073]:         <nova:port uuid="f4541341-e046-4363-ae69-dc00b3ce4f03">
Nov 24 10:20:53 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:20:53 user nova-compute[75073]:         </nova:port>
Nov 24 10:20:53 user nova-compute[75073]:       </nova:ports>
Nov 24 10:20:53 user nova-compute[75073]:     </nova:instance>
Nov 24 10:20:53 user nova-compute[75073]:   </metadata>
Nov 24 10:20:53 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:20:53 user nova-compute[75073]:     <system>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="serial">ccb126e6-2e9f-400e-9351-8183056a5410</entry>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="uuid">ccb126e6-2e9f-400e-9351-8183056a5410</entry>
Nov 24 10:20:53 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:20:53 user nova-compute[75073]:     </system>
Nov 24 10:20:53 user nova-compute[75073]:   </sysinfo>
Nov 24 10:20:53 user nova-compute[75073]:   <os>
Nov 24 10:20:53 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:20:53 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:20:53 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:20:53 user nova-compute[75073]:   </os>
Nov 24 10:20:53 user nova-compute[75073]:   <features>
Nov 24 10:20:53 user nova-compute[75073]:     <acpi/>
Nov 24 10:20:53 user nova-compute[75073]:     <apic/>
Nov 24 10:20:53 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:20:53 user nova-compute[75073]:   </features>
Nov 24 10:20:53 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:20:53 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:20:53 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:20:53 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:20:53 user nova-compute[75073]:   </clock>
Nov 24 10:20:53 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:20:53 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:20:53 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:20:53 user nova-compute[75073]:   </cpu>
Nov 24 10:20:53 user nova-compute[75073]:   <devices>
Nov 24 10:20:53 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:20:53 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:20:53 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk"/>
Nov 24 10:20:53 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:20:53 user nova-compute[75073]:     </disk>
Nov 24 10:20:53 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:20:53 user nova-compute[75073]:       <mac address="fa:16:3e:1e:76:dc"/>
Nov 24 10:20:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:20:53 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:20:53 user nova-compute[75073]:       <target dev="tapf4541341-e0"/>
Nov 24 10:20:53 user nova-compute[75073]:     </interface>
Nov 24 10:20:53 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:20:53 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/console.log" append="off"/>
Nov 24 10:20:53 user nova-compute[75073]:     </serial>
Nov 24 10:20:53 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:20:53 user nova-compute[75073]:     <video>
Nov 24 10:20:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:20:53 user nova-compute[75073]:     </video>
Nov 24 10:20:53 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:20:53 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:20:53 user nova-compute[75073]:     </rng>
Nov 24 10:20:53 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:20:53 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:20:53 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:20:53 user nova-compute[75073]:     </memballoon>
Nov 24 10:20:53 user nova-compute[75073]:   </devices>
Nov 24 10:20:53 user nova-compute[75073]: </domain>
Nov 24 10:20:53 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-702734092',display_name='tempest-ServerRescueNegativeTestJSON-server-702734092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-702734092',id=2,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-76dwo0cl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:20:46Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=ccb126e6-2e9f-400e-9351-8183056a5410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG os_vif [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8256def5-6a63-5ecf-9581-489dc631765d', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-changed-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Refreshing instance network info cache due to event network-changed-f4541341-e046-4363-ae69-dc00b3ce4f03. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:20:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Refreshing network info cache for port f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:20:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updated VIF entry in instance network info cache for port 86f2db00-09e3-4054-a321-99883e964598. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:20:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:20:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea5ff29-2091-4431-997b-5a72e2fa65c7 req-a91e4e51-3420-4782-8cdc-654c00d83fc8 service nova] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:20:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:54 user sudo[84414]: pam_unix(sudo:session): session closed for user root
Nov 24 10:20:54 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Spawned new privsep daemon via rootwrap
Nov 24 10:20:54 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 10:20:54 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 10:20:54 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 24 10:20:54 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84453
Nov 24 10:20:54 user nova-compute[75073]: WARNING oslo_privsep.priv_context [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] privsep daemon already running
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86f2db00-09, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86f2db00-09, col_values=(('qos', UUID('907f66d3-f998-4063-9f2c-68b024b69313')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86f2db00-09, col_values=(('external_ids', {'iface-id': '86f2db00-09e3-4054-a321-99883e964598', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:11:5a', 'vm-uuid': '368baad5-b756-4ae5-aa18-9d148632523d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:55 user nova-compute[75073]: INFO os_vif [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09')
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4541341-e0, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4541341-e0, col_values=(('qos', UUID('be34f089-31a7-4069-9f8d-03a899a1c9eb')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4541341-e0, col_values=(('external_ids', {'iface-id': 'f4541341-e046-4363-ae69-dc00b3ce4f03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:76:dc', 'vm-uuid': 'ccb126e6-2e9f-400e-9351-8183056a5410'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:55 user nova-compute[75073]: INFO os_vif [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0')
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:23:11:5a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:1e:76:dc, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updated VIF entry in instance network info cache for port f4541341-e046-4363-ae69-dc00b3ce4f03. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-799d63dd-00ea-4786-a5b5-01026ecc61a9 req-5bb2df15-bb1c-4195-85b4-0ec3fef50c40 service nova] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:20:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance spawned successfully.
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance spawned successfully.
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Took 14.40 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Took 16.26 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.compute.manager [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Took 15.28 seconds to build instance.
Nov 24 10:21:00 user nova-compute[75073]: INFO nova.compute.manager [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Took 17.25 seconds to build instance.
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-52b57ba6-8448-4dc2-84f2-632a3091950d tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.535s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-95e3c304-c74c-45f8-9445-272a84c86d0f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.887s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:01 user nova-compute[75073]: INFO nova.compute.claims [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Claim successful on node user
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:02 user nova-compute[75073]: WARNING nova.compute.manager [req-46d9c7e5-124c-45f1-8f81-a60762785316 req-69e966c4-8ef0-42bd-80ff-da63edb7190d service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state None.
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.352s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:02 user nova-compute[75073]: INFO nova.compute.claims [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Claim successful on node user
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.policy [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09ba54648b745e6a09eed8514b7376a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcfd0f8a9fe42ada311dcc1047b3c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Creating image(s)
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "/opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "/opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "/opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.253s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.policy [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad3d4968c7254d35b546543de4205ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d9ba5f495d45e183eb356e1d5313f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.359s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Creating image(s)
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "/opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "/opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk 1073741824" returned: 0 in 0.093s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.455s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.224s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Cannot resize image /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Ensure instance console log exists: /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.253s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk 1073741824" returned: 0 in 0.067s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:04 user nova-compute[75073]: WARNING nova.compute.manager [req-443504d8-05d6-4c45-9a3a-b0dbb33d45c7 req-9e2a0b1d-f9a3-459a-92d6-df8777b1df70 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state None.
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.326s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Successfully created port: 4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Cannot resize image /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Ensure instance console log exists: /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Successfully created port: 748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Successfully updated port: 4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquired lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-changed-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Refreshing instance network info cache due to event network-changed-4b42b912-6f43-459a-8b4f-09678aa5d133. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] Acquiring lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Successfully updated port: 748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquired lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating instance_info_cache with network_info: [{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Releasing lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Instance network_info: |[{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] Acquired lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Refreshing network info cache for port 4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Start _get_guest_xml network_info=[{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1504972674',display_name='tempest-VolumesAdminNegativeTest-server-1504972674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1504972674',id=3,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNavL9I3BzmusxCesLV64P81WQWvO4lfNsoUBYDdHeSd4cLQ39vlPByusSbmGbrBIfB/Pz24XDfQLBm+139xmOl/az+RwpTwucEzuFMcfnAQaR2mBKRk/D5SXYkRuopmg==',key_name='tempest-keypair-2034053659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-ln8506sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09ba54648b745e6a09eed8514b7376a',uuid=facaa348-1d98-45d0-8ea8-77746a7f943f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'pci_devices' on Instance uuid facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:07 user nova-compute[75073]:   <uuid>facaa348-1d98-45d0-8ea8-77746a7f943f</uuid>
Nov 24 10:21:07 user nova-compute[75073]:   <name>instance-00000003</name>
Nov 24 10:21:07 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:07 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:07 user nova-compute[75073]:   <metadata>
Nov 24 10:21:07 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:07 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1504972674</nova:name>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:07</nova:creationTime>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:07 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:07 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:user uuid="a09ba54648b745e6a09eed8514b7376a">tempest-VolumesAdminNegativeTest-1494900621-project-member</nova:user>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:project uuid="8bcfd0f8a9fe42ada311dcc1047b3c79">tempest-VolumesAdminNegativeTest-1494900621</nova:project>
Nov 24 10:21:07 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:21:07 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:07 user nova-compute[75073]:         <nova:port uuid="4b42b912-6f43-459a-8b4f-09678aa5d133">
Nov 24 10:21:07 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:21:07 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:07 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:07 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:07 user nova-compute[75073]:   </metadata>
Nov 24 10:21:07 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:07 user nova-compute[75073]:     <system>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="serial">facaa348-1d98-45d0-8ea8-77746a7f943f</entry>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="uuid">facaa348-1d98-45d0-8ea8-77746a7f943f</entry>
Nov 24 10:21:07 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:07 user nova-compute[75073]:     </system>
Nov 24 10:21:07 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:07 user nova-compute[75073]:   <os>
Nov 24 10:21:07 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:07 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:07 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:07 user nova-compute[75073]:   </os>
Nov 24 10:21:07 user nova-compute[75073]:   <features>
Nov 24 10:21:07 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:07 user nova-compute[75073]:     <apic/>
Nov 24 10:21:07 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:07 user nova-compute[75073]:   </features>
Nov 24 10:21:07 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:07 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:07 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:07 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:07 user nova-compute[75073]:   </clock>
Nov 24 10:21:07 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:07 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:07 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:07 user nova-compute[75073]:   </cpu>
Nov 24 10:21:07 user nova-compute[75073]:   <devices>
Nov 24 10:21:07 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:21:07 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:21:07 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk"/>
Nov 24 10:21:07 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:21:07 user nova-compute[75073]:     </disk>
Nov 24 10:21:07 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:07 user nova-compute[75073]:       <mac address="fa:16:3e:29:9b:30"/>
Nov 24 10:21:07 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:07 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:07 user nova-compute[75073]:       <target dev="tap4b42b912-6f"/>
Nov 24 10:21:07 user nova-compute[75073]:     </interface>
Nov 24 10:21:07 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:07 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/console.log" append="off"/>
Nov 24 10:21:07 user nova-compute[75073]:     </serial>
Nov 24 10:21:07 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:07 user nova-compute[75073]:     <video>
Nov 24 10:21:07 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:07 user nova-compute[75073]:     </video>
Nov 24 10:21:07 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:07 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:07 user nova-compute[75073]:     </rng>
Nov 24 10:21:07 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:07 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:07 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:07 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:07 user nova-compute[75073]:   </devices>
Nov 24 10:21:07 user nova-compute[75073]: </domain>
Nov 24 10:21:07 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1504972674',display_name='tempest-VolumesAdminNegativeTest-server-1504972674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1504972674',id=3,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNavL9I3BzmusxCesLV64P81WQWvO4lfNsoUBYDdHeSd4cLQ39vlPByusSbmGbrBIfB/Pz24XDfQLBm+139xmOl/az+RwpTwucEzuFMcfnAQaR2mBKRk/D5SXYkRuopmg==',key_name='tempest-keypair-2034053659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-ln8506sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09ba54648b745e6a09eed8514b7376a',uuid=facaa348-1d98-45d0-8ea8-77746a7f943f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG os_vif [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f23f50ab-5842-5d14-8523-074f92c1ec0a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b42b912-6f, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b42b912-6f, col_values=(('qos', UUID('63e9f070-4ca9-43f1-904e-2deec5a0390a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b42b912-6f, col_values=(('external_ids', {'iface-id': '4b42b912-6f43-459a-8b4f-09678aa5d133', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:9b:30', 'vm-uuid': 'facaa348-1d98-45d0-8ea8-77746a7f943f'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:07 user nova-compute[75073]: INFO os_vif [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f')
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No VIF found with MAC fa:16:3e:29:9b:30, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.neutron [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating instance_info_cache with network_info: [{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Releasing lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Instance network_info: |[{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Start _get_guest_xml network_info=[{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:08 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:08 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1533894683',display_name='tempest-TestVolumeSwap-server-1533894683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1533894683',id=4,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHB9bExe2petiiqkKBav8TiRhRW29ynlEsPGqTPmSV5psGbsbBC55eiLY8wtSPy9x+PF9358qh0jK1waaIbS8SKalf0rA28fTwZKKqqC6NVP38WXf63Rr11RTgexiwx/w==',key_name='tempest-keypair-278561638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d9ba5f495d45e183eb356e1d5313f6',ramdisk_id='',reservation_id='r-is53q39i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-810790799',owner_user_name='tempest-TestVolumeSwap-810790799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d4968c7254d35b546543de4205ae9',uuid=fb7cefcf-9df1-4174-b68c-addb1af850a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converting VIF {"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lazy-loading 'pci_devices' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:08 user nova-compute[75073]:   <uuid>fb7cefcf-9df1-4174-b68c-addb1af850a0</uuid>
Nov 24 10:21:08 user nova-compute[75073]:   <name>instance-00000004</name>
Nov 24 10:21:08 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:08 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:08 user nova-compute[75073]:   <metadata>
Nov 24 10:21:08 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:08 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:name>tempest-TestVolumeSwap-server-1533894683</nova:name>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:08</nova:creationTime>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:08 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:08 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:user uuid="ad3d4968c7254d35b546543de4205ae9">tempest-TestVolumeSwap-810790799-project-member</nova:user>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:project uuid="e1d9ba5f495d45e183eb356e1d5313f6">tempest-TestVolumeSwap-810790799</nova:project>
Nov 24 10:21:08 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:21:08 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:08 user nova-compute[75073]:         <nova:port uuid="748ee9e7-1f70-41a7-9e50-fb8e09a501ff">
Nov 24 10:21:08 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:21:08 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:08 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:08 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:08 user nova-compute[75073]:   </metadata>
Nov 24 10:21:08 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:08 user nova-compute[75073]:     <system>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="serial">fb7cefcf-9df1-4174-b68c-addb1af850a0</entry>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="uuid">fb7cefcf-9df1-4174-b68c-addb1af850a0</entry>
Nov 24 10:21:08 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:08 user nova-compute[75073]:     </system>
Nov 24 10:21:08 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:08 user nova-compute[75073]:   <os>
Nov 24 10:21:08 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:08 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:08 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:08 user nova-compute[75073]:   </os>
Nov 24 10:21:08 user nova-compute[75073]:   <features>
Nov 24 10:21:08 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:08 user nova-compute[75073]:     <apic/>
Nov 24 10:21:08 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:08 user nova-compute[75073]:   </features>
Nov 24 10:21:08 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:08 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:08 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:08 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:08 user nova-compute[75073]:   </clock>
Nov 24 10:21:08 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:08 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:08 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:08 user nova-compute[75073]:   </cpu>
Nov 24 10:21:08 user nova-compute[75073]:   <devices>
Nov 24 10:21:08 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:21:08 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:21:08 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk"/>
Nov 24 10:21:08 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:21:08 user nova-compute[75073]:     </disk>
Nov 24 10:21:08 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:08 user nova-compute[75073]:       <mac address="fa:16:3e:94:60:6b"/>
Nov 24 10:21:08 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:08 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:08 user nova-compute[75073]:       <target dev="tap748ee9e7-1f"/>
Nov 24 10:21:08 user nova-compute[75073]:     </interface>
Nov 24 10:21:08 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:08 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/console.log" append="off"/>
Nov 24 10:21:08 user nova-compute[75073]:     </serial>
Nov 24 10:21:08 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:08 user nova-compute[75073]:     <video>
Nov 24 10:21:08 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:08 user nova-compute[75073]:     </video>
Nov 24 10:21:08 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:08 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:08 user nova-compute[75073]:     </rng>
Nov 24 10:21:08 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:08 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:08 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:08 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:08 user nova-compute[75073]:   </devices>
Nov 24 10:21:08 user nova-compute[75073]: </domain>
Nov 24 10:21:08 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1533894683',display_name='tempest-TestVolumeSwap-server-1533894683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1533894683',id=4,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHB9bExe2petiiqkKBav8TiRhRW29ynlEsPGqTPmSV5psGbsbBC55eiLY8wtSPy9x+PF9358qh0jK1waaIbS8SKalf0rA28fTwZKKqqC6NVP38WXf63Rr11RTgexiwx/w==',key_name='tempest-keypair-278561638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1d9ba5f495d45e183eb356e1d5313f6',ramdisk_id='',reservation_id='r-is53q39i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-810790799',owner_user_name='tempest-TestVolumeSwap-810790799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d4968c7254d35b546543de4205ae9',uuid=fb7cefcf-9df1-4174-b68c-addb1af850a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converting VIF {"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG os_vif [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eba5d809-c2a1-5cbd-b918-0b1935313415', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap748ee9e7-1f, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap748ee9e7-1f, col_values=(('qos', UUID('4e2e2388-6b6a-4444-957b-a409c728640a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap748ee9e7-1f, col_values=(('external_ids', {'iface-id': '748ee9e7-1f70-41a7-9e50-fb8e09a501ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:60:6b', 'vm-uuid': 'fb7cefcf-9df1-4174-b68c-addb1af850a0'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updated VIF entry in instance network info cache for port 4b42b912-6f43-459a-8b4f-09678aa5d133. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating instance_info_cache with network_info: [{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:08 user nova-compute[75073]: INFO os_vif [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f')
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bba96edf-7789-44cb-bd9a-a925b6f2209b req-cb027c3d-ed97-4ece-a2ff-b211c8925018 service nova] Releasing lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] No VIF found with MAC fa:16:3e:94:60:6b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:08 user nova-compute[75073]: INFO nova.compute.claims [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Claim successful on node user
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-changed-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Refreshing instance network info cache due to event network-changed-748ee9e7-1f70-41a7-9e50-fb8e09a501ff. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] Acquiring lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] Acquired lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Refreshing network info cache for port 748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.815s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updated VIF entry in instance network info cache for port 748ee9e7-1f70-41a7-9e50-fb8e09a501ff. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating instance_info_cache with network_info: [{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-393cb017-807c-4916-9089-9fd0e6f52c94 req-59ba9e97-3ea6-4a44-9a88-94e99c8a3269 service nova] Releasing lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:09 user nova-compute[75073]: DEBUG nova.policy [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38c3bb8e82e84c83ac6632cdf8500ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3de0eafd4394b549aca7bfeecc5e673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Creating image(s)
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.011s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.part --force-share --output=json" returned: 0 in 0.663s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:11 user nova-compute[75073]: DEBUG nova.virt.images [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] 3c495efe-92bd-4f04-b255-434e5752edad was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:21:11 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:21:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.part /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:12 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Successfully created port: 2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.part /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.converted" returned: 0 in 1.437s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.213s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json" returned: 0 in 0.333s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json" returned: 0 in 0.321s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40,backing_fmt=raw /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40,backing_fmt=raw /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk 1073741824" returned: 0 in 0.157s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "8ecbcaf7cfcc10ee60adfd8a315f561577728a40" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.489s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 --force-share --output=json" returned: 0 in 0.257s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Cannot resize image /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Successfully updated port: 2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquired lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-changed-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Refreshing instance network info cache due to event network-changed-2960f7ca-09c6-490e-95b0-5de751a66fee. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] Acquiring lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:15 user nova-compute[75073]: INFO nova.compute.claims [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Claim successful on node user
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updating instance_info_cache with network_info: [{"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Releasing lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Instance network_info: |[{"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] Acquired lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Refreshing network info cache for port 2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Start _get_guest_xml network_info=[{"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:20:59Z,direct_url=<?>,disk_format='qcow2',id=3c495efe-92bd-4f04-b255-434e5752edad,min_disk=0,min_ram=0,name='',owner='e628dade2e0242598f60cb2641fdf4ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:21:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '3c495efe-92bd-4f04-b255-434e5752edad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:20:59Z,direct_url=<?>,disk_format='qcow2',id=3c495efe-92bd-4f04-b255-434e5752edad,min_disk=0,min_ram=0,name='',owner='e628dade2e0242598f60cb2641fdf4ae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:21:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1534884870',display_name='tempest-AttachSCSIVolumeTestJSON-server-1534884870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1534884870',id=5,image_ref='3c495efe-92bd-4f04-b255-434e5752edad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcZ/NINDUyMux9tFn26e5vXbHZ6dBsl0I82iduplNm67TD3KDvuRXNNtxSDCdBkrz3A3jmSwqDIeNmyJsDpUvkLrXh90rtXV/bRNfRQSs3nVWzO1sF3NTrQsuVfNqtwYQ==',key_name='tempest-keypair-20128217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3de0eafd4394b549aca7bfeecc5e673',ramdisk_id='',reservation_id='r-jfuh6394',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3c495efe-92bd-4f04-b255-434e5752edad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-253116183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-253116183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38c3bb8e82e84c83ac6632cdf8500ecd',uuid=fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converting VIF {"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lazy-loading 'pci_devices' on Instance uuid fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:15 user nova-compute[75073]:   <uuid>fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9</uuid>
Nov 24 10:21:15 user nova-compute[75073]:   <name>instance-00000005</name>
Nov 24 10:21:15 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:15 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:15 user nova-compute[75073]:   <metadata>
Nov 24 10:21:15 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:15 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1534884870</nova:name>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:15</nova:creationTime>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:15 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:15 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:user uuid="38c3bb8e82e84c83ac6632cdf8500ecd">tempest-AttachSCSIVolumeTestJSON-253116183-project-member</nova:user>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:project uuid="f3de0eafd4394b549aca7bfeecc5e673">tempest-AttachSCSIVolumeTestJSON-253116183</nova:project>
Nov 24 10:21:15 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:root type="image" uuid="3c495efe-92bd-4f04-b255-434e5752edad"/>
Nov 24 10:21:15 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:15 user nova-compute[75073]:         <nova:port uuid="2960f7ca-09c6-490e-95b0-5de751a66fee">
Nov 24 10:21:15 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:21:15 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:15 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:15 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:15 user nova-compute[75073]:   </metadata>
Nov 24 10:21:15 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:15 user nova-compute[75073]:     <system>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="serial">fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9</entry>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="uuid">fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9</entry>
Nov 24 10:21:15 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:15 user nova-compute[75073]:     </system>
Nov 24 10:21:15 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:15 user nova-compute[75073]:   <os>
Nov 24 10:21:15 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:15 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:15 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:15 user nova-compute[75073]:   </os>
Nov 24 10:21:15 user nova-compute[75073]:   <features>
Nov 24 10:21:15 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:15 user nova-compute[75073]:     <apic/>
Nov 24 10:21:15 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:15 user nova-compute[75073]:   </features>
Nov 24 10:21:15 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:15 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:15 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:15 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:15 user nova-compute[75073]:   </clock>
Nov 24 10:21:15 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:15 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:15 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:15 user nova-compute[75073]:   </cpu>
Nov 24 10:21:15 user nova-compute[75073]:   <devices>
Nov 24 10:21:15 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:21:15 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:21:15 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk"/>
Nov 24 10:21:15 user nova-compute[75073]:       <target dev="sda" bus="scsi"/>
Nov 24 10:21:15 user nova-compute[75073]:       <address type="drive" controller="0" unit="0"/>
Nov 24 10:21:15 user nova-compute[75073]:     </disk>
Nov 24 10:21:15 user nova-compute[75073]:     <disk type="file" device="cdrom">
Nov 24 10:21:15 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 10:21:15 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.config"/>
Nov 24 10:21:15 user nova-compute[75073]:       <target dev="sdb" bus="scsi"/>
Nov 24 10:21:15 user nova-compute[75073]:       <address type="drive" controller="0" unit="1"/>
Nov 24 10:21:15 user nova-compute[75073]:     </disk>
Nov 24 10:21:15 user nova-compute[75073]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 24 10:21:15 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:15 user nova-compute[75073]:       <mac address="fa:16:3e:d8:75:9c"/>
Nov 24 10:21:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:15 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:15 user nova-compute[75073]:       <target dev="tap2960f7ca-09"/>
Nov 24 10:21:15 user nova-compute[75073]:     </interface>
Nov 24 10:21:15 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:15 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/console.log" append="off"/>
Nov 24 10:21:15 user nova-compute[75073]:     </serial>
Nov 24 10:21:15 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:15 user nova-compute[75073]:     <video>
Nov 24 10:21:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:15 user nova-compute[75073]:     </video>
Nov 24 10:21:15 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:15 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:15 user nova-compute[75073]:     </rng>
Nov 24 10:21:15 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:15 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:15 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:15 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:15 user nova-compute[75073]:   </devices>
Nov 24 10:21:15 user nova-compute[75073]: </domain>
Nov 24 10:21:15 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1534884870',display_name='tempest-AttachSCSIVolumeTestJSON-server-1534884870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1534884870',id=5,image_ref='3c495efe-92bd-4f04-b255-434e5752edad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcZ/NINDUyMux9tFn26e5vXbHZ6dBsl0I82iduplNm67TD3KDvuRXNNtxSDCdBkrz3A3jmSwqDIeNmyJsDpUvkLrXh90rtXV/bRNfRQSs3nVWzO1sF3NTrQsuVfNqtwYQ==',key_name='tempest-keypair-20128217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3de0eafd4394b549aca7bfeecc5e673',ramdisk_id='',reservation_id='r-jfuh6394',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3c495efe-92bd-4f04-b255-434e5752edad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-253116183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-253116183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38c3bb8e82e84c83ac6632cdf8500ecd',uuid=fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converting VIF {"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG os_vif [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef2b32b2-27a5-55a0-9fb2-a3937dd20397', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2960f7ca-09, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2960f7ca-09, col_values=(('qos', UUID('096970d3-cca4-4fef-a416-229db338861a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2960f7ca-09, col_values=(('external_ids', {'iface-id': '2960f7ca-09c6-490e-95b0-5de751a66fee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:75:9c', 'vm-uuid': 'fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:15 user nova-compute[75073]: INFO os_vif [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09')
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:15 user nova-compute[75073]: WARNING nova.compute.manager [req-4836ea02-0781-4c41-9a13-a0833315fa43 req-4c97d6ea-12df-4ea7-b496-21222ba5d060 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state building and task_state spawning.
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No BDM found with device name sda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No VIF found with MAC fa:16:3e:d8:75:9c, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Using config drive
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.974s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.581s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:15 user nova-compute[75073]: INFO nova.compute.claims [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Claim successful on node user
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updated VIF entry in instance network info cache for port 2960f7ca-09c6-490e-95b0-5de751a66fee. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updating instance_info_cache with network_info: [{"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97aff09-3dfc-4c53-be52-2905dbbd0daa req-cf8c8f1b-cf93-40e9-806e-2c112f0e92e7 service nova] Releasing lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.policy [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb6e6c16c4c4638a91632bee60f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb11f3d47f45c7a467c206134af82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Creating image(s)
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Creating config drive at /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.config
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_9xbmxgr {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Instance spawned successfully.
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_9xbmxgr" returned: 0 in 0.108s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.242s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Instance spawned successfully.
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.288s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Took 13.48 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Took 14.18 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk 1073741824" returned: 0 in 0.105s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.policy [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92552b1336c84ed3a664b4e081c1ab19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d54989ce7c43ed9591752dfca4b618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.253s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.compute.manager [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Took 15.80 seconds to build instance.
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.virt.block_device [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Booting with volume c219be38-d43f-46f2-b035-d18e8225d603 at /dev/vda
Nov 24 10:21:17 user nova-compute[75073]: INFO nova.compute.manager [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Took 15.63 seconds to build instance.
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7e010610-9d59-47c9-9e15-f76042146e8e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.181s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-30166fe7-e0b2-4a10-9a27-5f2443dba73d tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.902s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG os_brick.utils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:21:17 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpegi66syw/privsep.sock']
Nov 24 10:21:17 user sudo[85136]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpegi66syw/privsep.sock
Nov 24 10:21:17 user sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Successfully created port: ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:17 user nova-compute[75073]: WARNING nova.compute.manager [req-ee831af9-df05-4459-9432-fbd39026d60c req-8a11eae6-da65-43d1-84eb-2f714af11564 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state active and task_state None.
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.438s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Cannot resize image /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Ensure instance console log exists: /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Successfully created port: fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Successfully updated port: ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] No waiting events found dispatching network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:19 user nova-compute[75073]: WARNING nova.compute.manager [req-f944f0eb-e573-49eb-96be-a5648aa530d9 req-0c877c98-1d91-4ba9-8cf5-59190a8183ba service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received unexpected event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee for instance with vm_state building and task_state spawning.
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-changed-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing instance network info cache due to event network-changed-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:20 user sudo[85136]: pam_unix(sudo:session): session closed for user root
Nov 24 10:21:20 user nova-compute[75073]: INFO oslo.privsep.daemon [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Spawned new privsep daemon via rootwrap
Nov 24 10:21:20 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 10:21:20 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 10:21:20 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 24 10:21:20 user nova-compute[75073]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85267
Nov 24 10:21:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd84a30-b814-4b13-bbe0-bd12e0e48f64]: (2,) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Instance network_info: |[{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.network.neutron [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing network info cache for port ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Start _get_guest_xml network_info=[{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:20 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:20 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.objects.instance [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'pci_devices' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:21 user nova-compute[75073]:   <uuid>b745dbf9-0dc2-4d1a-b709-d48422e9a537</uuid>
Nov 24 10:21:21 user nova-compute[75073]:   <name>instance-00000006</name>
Nov 24 10:21:21 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:21 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:21 user nova-compute[75073]:   <metadata>
Nov 24 10:21:21 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:21 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:20</nova:creationTime>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:21 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:21 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:21:21 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:21:21 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:21 user nova-compute[75073]:         <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:21:21 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:21:21 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:21 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:21 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:21 user nova-compute[75073]:   </metadata>
Nov 24 10:21:21 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:21 user nova-compute[75073]:     <system>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="serial">b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="uuid">b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:21:21 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:21 user nova-compute[75073]:     </system>
Nov 24 10:21:21 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:21 user nova-compute[75073]:   <os>
Nov 24 10:21:21 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:21 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:21 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:21 user nova-compute[75073]:   </os>
Nov 24 10:21:21 user nova-compute[75073]:   <features>
Nov 24 10:21:21 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:21 user nova-compute[75073]:     <apic/>
Nov 24 10:21:21 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:21 user nova-compute[75073]:   </features>
Nov 24 10:21:21 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:21 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:21 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:21 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:21 user nova-compute[75073]:   </clock>
Nov 24 10:21:21 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:21 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:21 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:21 user nova-compute[75073]:   </cpu>
Nov 24 10:21:21 user nova-compute[75073]:   <devices>
Nov 24 10:21:21 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:21:21 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:21:21 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk"/>
Nov 24 10:21:21 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:21:21 user nova-compute[75073]:     </disk>
Nov 24 10:21:21 user nova-compute[75073]:     <disk type="file" device="cdrom">
Nov 24 10:21:21 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 10:21:21 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config"/>
Nov 24 10:21:21 user nova-compute[75073]:       <target dev="hda" bus="ide"/>
Nov 24 10:21:21 user nova-compute[75073]:     </disk>
Nov 24 10:21:21 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:21 user nova-compute[75073]:       <mac address="fa:16:3e:74:6e:7f"/>
Nov 24 10:21:21 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:21 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:21 user nova-compute[75073]:       <target dev="tapec1d3f24-31"/>
Nov 24 10:21:21 user nova-compute[75073]:     </interface>
Nov 24 10:21:21 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:21 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log" append="off"/>
Nov 24 10:21:21 user nova-compute[75073]:     </serial>
Nov 24 10:21:21 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:21 user nova-compute[75073]:     <video>
Nov 24 10:21:21 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:21 user nova-compute[75073]:     </video>
Nov 24 10:21:21 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:21 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:21 user nova-compute[75073]:     </rng>
Nov 24 10:21:21 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:21 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:21 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:21 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:21 user nova-compute[75073]:   </devices>
Nov 24 10:21:21 user nova-compute[75073]: </domain>
Nov 24 10:21:21 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_vif [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Successfully updated port: fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e067f6eb-7987-5faa-9ff1-858dfe7fecbd', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec1d3f24-31, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec1d3f24-31, col_values=(('qos', UUID('98813223-d3c2-4e66-996a-608b859e5a3f')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec1d3f24-31, col_values=(('external_ids', {'iface-id': 'ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:6e:7f', 'vm-uuid': 'b745dbf9-0dc2-4d1a-b709-d48422e9a537'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[205444cd-0933-4aa0-bc08-62f94a65bb4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:21 user nova-compute[75073]: WARNING os_brick.initiator.connectors.nvmeof [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 24 10:21:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:21 user nova-compute[75073]: INFO os_vif [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31')
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquired lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[91329310-5d9f-4fdc-8fce-46bb4461cdc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11331d6-5bb8-4dba-a6c1-70caf176cf46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de0a36-b2b6-45ce-8061-b9d2eead9ead]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:21 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3173c5-0675-4e60-8a43-831a9436d15f]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== get_connector_properties: return (3581ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating existing volume attachment record: d975e466-d95b-41b0-ad2b-055c64f33a74 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name hda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No VIF found with MAC fa:16:3e:74:6e:7f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Using config drive
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:21 user nova-compute[75073]: INFO nova.compute.claims [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Claim successful on node user
Nov 24 10:21:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Creating config drive at /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy59kmb0r {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy59kmb0r" returned: 0 in 0.083s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] No waiting events found dispatching network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:21 user nova-compute[75073]: WARNING nova.compute.manager [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received unexpected event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee for instance with vm_state building and task_state spawning.
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-changed-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Refreshing instance network info cache due to event network-changed-fcf31f42-7b47-49a6-be6a-83eda2801879. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Acquiring lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating instance_info_cache with network_info: [{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Releasing lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance network_info: |[{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Acquired lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Refreshing network info cache for port fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.798s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updated VIF entry in instance network info cache for port ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-deadfcb5-8fad-4e08-ba66-1e336a2d26d2 req-12cdd2c1-74eb-4c4a-b814-3883adfa6ddd service nova] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Instance spawned successfully.
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.policy [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e3961e3742f41e698a259c3618b5881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1fc6e9e61a41139aeb14b05aade55b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Creating image(s)
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "/opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "/opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:22 user nova-compute[75073]: INFO nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Took 12.74 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:22 user nova-compute[75073]: INFO nova.compute.manager [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Took 14.15 seconds to build instance.
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.279s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8a666315-a33e-4048-becf-7c3ab7523bf5 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.363s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.234s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG nova.network.neutron [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updated VIF entry in instance network info cache for port fcf31f42-7b47-49a6-be6a-83eda2801879. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG nova.network.neutron [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating instance_info_cache with network_info: [{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk 1073741824" returned: 0 in 0.077s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fb8e62d-3d8e-4adb-a118-985d73d57a1e req-b80a110a-1bbc-427a-bd45-5ecaf61e8f28 service nova] Releasing lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Cannot resize image /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Successfully created port: 36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:24 user nova-compute[75073]: WARNING nova.compute.manager [req-05202188-560e-4b23-8786-9dd5787174fb req-88cb4be0-8fa5-4b94-baaa-515ce5b77ecf service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c for instance with vm_state building and task_state spawning.
Nov 24 10:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Successfully updated port: 36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquired lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-changed-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Refreshing instance network info cache due to event network-changed-36c78c3f-e3c0-471c-b502-e3441b678fae. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] Acquiring lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating instance_info_cache with network_info: [{"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Releasing lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Instance network_info: |[{"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] Acquired lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.network.neutron [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Refreshing network info cache for port 36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Start _get_guest_xml network_info=[{"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:25 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:25 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-909473074',display_name='tempest-VolumesAssistedSnapshotsTest-server-909473074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-909473074',id=8,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmXRI/Qjv9OCg3Z7qu22wnlwsfDf0Axoz9HA4u1gvwQwxP55PBhm1jhReQZC6L9EEoUq5kh30Mj77HMcy9oT7ZDdACOTd3HJlVHcsmSYEliEJV9YzH/IEpNt2fi2Y24VA==',key_name='tempest-keypair-371898589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1fc6e9e61a41139aeb14b05aade55b',ramdisk_id='',reservation_id='r-mfaqcu7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1321987503',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1321987503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3961e3742f41e698a259c3618b5881',uuid=9fe059bc-6c9e-4cb5-99d0-c96f28e287d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converting VIF {"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:26 user nova-compute[75073]:   <uuid>9fe059bc-6c9e-4cb5-99d0-c96f28e287d8</uuid>
Nov 24 10:21:26 user nova-compute[75073]:   <name>instance-00000008</name>
Nov 24 10:21:26 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:26 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:26 user nova-compute[75073]:   <metadata>
Nov 24 10:21:26 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:26 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-909473074</nova:name>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:25</nova:creationTime>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:26 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:26 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:user uuid="5e3961e3742f41e698a259c3618b5881">tempest-VolumesAssistedSnapshotsTest-1321987503-project-member</nova:user>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:project uuid="cc1fc6e9e61a41139aeb14b05aade55b">tempest-VolumesAssistedSnapshotsTest-1321987503</nova:project>
Nov 24 10:21:26 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:21:26 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:26 user nova-compute[75073]:         <nova:port uuid="36c78c3f-e3c0-471c-b502-e3441b678fae">
Nov 24 10:21:26 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:21:26 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:26 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:26 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:26 user nova-compute[75073]:   </metadata>
Nov 24 10:21:26 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:26 user nova-compute[75073]:     <system>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="serial">9fe059bc-6c9e-4cb5-99d0-c96f28e287d8</entry>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="uuid">9fe059bc-6c9e-4cb5-99d0-c96f28e287d8</entry>
Nov 24 10:21:26 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:26 user nova-compute[75073]:     </system>
Nov 24 10:21:26 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:26 user nova-compute[75073]:   <os>
Nov 24 10:21:26 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:26 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:26 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:26 user nova-compute[75073]:   </os>
Nov 24 10:21:26 user nova-compute[75073]:   <features>
Nov 24 10:21:26 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:26 user nova-compute[75073]:     <apic/>
Nov 24 10:21:26 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:26 user nova-compute[75073]:   </features>
Nov 24 10:21:26 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:26 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:26 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:26 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:26 user nova-compute[75073]:   </clock>
Nov 24 10:21:26 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:26 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:26 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:26 user nova-compute[75073]:   </cpu>
Nov 24 10:21:26 user nova-compute[75073]:   <devices>
Nov 24 10:21:26 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:21:26 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:21:26 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk"/>
Nov 24 10:21:26 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:21:26 user nova-compute[75073]:     </disk>
Nov 24 10:21:26 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:26 user nova-compute[75073]:       <mac address="fa:16:3e:cb:1e:98"/>
Nov 24 10:21:26 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:26 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:26 user nova-compute[75073]:       <target dev="tap36c78c3f-e3"/>
Nov 24 10:21:26 user nova-compute[75073]:     </interface>
Nov 24 10:21:26 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:26 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/console.log" append="off"/>
Nov 24 10:21:26 user nova-compute[75073]:     </serial>
Nov 24 10:21:26 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:26 user nova-compute[75073]:     <video>
Nov 24 10:21:26 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:26 user nova-compute[75073]:     </video>
Nov 24 10:21:26 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:26 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:26 user nova-compute[75073]:     </rng>
Nov 24 10:21:26 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:26 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:26 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:26 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:26 user nova-compute[75073]:   </devices>
Nov 24 10:21:26 user nova-compute[75073]: </domain>
Nov 24 10:21:26 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-909473074',display_name='tempest-VolumesAssistedSnapshotsTest-server-909473074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-909473074',id=8,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmXRI/Qjv9OCg3Z7qu22wnlwsfDf0Axoz9HA4u1gvwQwxP55PBhm1jhReQZC6L9EEoUq5kh30Mj77HMcy9oT7ZDdACOTd3HJlVHcsmSYEliEJV9YzH/IEpNt2fi2Y24VA==',key_name='tempest-keypair-371898589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc1fc6e9e61a41139aeb14b05aade55b',ramdisk_id='',reservation_id='r-mfaqcu7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1321987503',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1321987503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3961e3742f41e698a259c3618b5881',uuid=9fe059bc-6c9e-4cb5-99d0-c96f28e287d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converting VIF {"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG os_vif [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78e89063-6fe0-51dc-b272-3bc25d6251c1', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36c78c3f-e3, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36c78c3f-e3, col_values=(('qos', UUID('c1417138-5dac-44df-9a1d-bc31bc4342d1')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36c78c3f-e3, col_values=(('external_ids', {'iface-id': '36c78c3f-e3c0-471c-b502-e3441b678fae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:1e:98', 'vm-uuid': '9fe059bc-6c9e-4cb5-99d0-c96f28e287d8'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:26 user nova-compute[75073]: INFO os_vif [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3')
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] No VIF found with MAC fa:16:3e:cb:1e:98, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updated VIF entry in instance network info cache for port 36c78c3f-e3c0-471c-b502-e3441b678fae. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating instance_info_cache with network_info: [{"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74516546-0789-4f80-808c-9d65f725ee3c req-2ede4d4f-66bf-49b3-b8b7-2237a657251f service nova] Releasing lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:26 user nova-compute[75073]: WARNING nova.compute.manager [req-da632569-7937-4861-9085-5c1b96a553f5 req-7617e7aa-ad4e-43ab-a7ef-773fbc8bcb31 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c for instance with vm_state building and task_state spawning.
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Instance spawned successfully.
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:27 user nova-compute[75073]: INFO nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Took 10.93 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:27 user nova-compute[75073]: INFO nova.compute.manager [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Took 12.72 seconds to build instance.
Nov 24 10:21:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bd0a3381-6934-44c6-a926-007b37eb85a1 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.017s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] No waiting events found dispatching network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:28 user nova-compute[75073]: WARNING nova.compute.manager [req-0fae3de8-7397-4478-b0ba-fd39e5a4fc8a req-a32684e9-087e-4c1b-91f3-4c07997578d0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received unexpected event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae for instance with vm_state building and task_state spawning.
Nov 24 10:21:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Skipping network cache update for instance because it is Building. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Skipping network cache update for instance because it is Building. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:21:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] No waiting events found dispatching network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:31 user nova-compute[75073]: WARNING nova.compute.manager [req-4ce5a11e-e57a-414d-be7d-2ed3f45b71f9 req-672ef801-c8e5-4954-8285-657278d3e58a service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received unexpected event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae for instance with vm_state building and task_state spawning.
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:21:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Creating image(s)
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Ensure instance console log exists: /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start _get_guest_xml network_info=[{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'd975e466-d95b-41b0-ad2b-055c64f33a74', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff8e177f-6cf4-4f93-b997-13ffacce99f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c219be38-d43f-46f2-b035-d18e8225d603', 'serial': 'c219be38-d43f-46f2-b035-d18e8225d603'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:21:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connector [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Factory for ISCSI on None {{(pid=75073) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.013s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:21:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:21:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:21:31 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Instance spawned successfully.
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[69888800-7e0c-405b-9475-98ddb3e9e845]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:21:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[062ee803-9535-4e30-a155-17df697b40e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603] added
Nov 24 10:21:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c9950-8398-4f35-aa5c-54ca4569e083]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd6e8f-28c8-4144-b166-09e9aea3ba55]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPoZXVSb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPoZXVSb" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f082f-85f5-4605-94b6-3b8f6467ee90]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPoZXVSb'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: INFO nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Took 9.21 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b78ce9c-6553-4ab1-b8a1-398e4225e9b7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dafa144-2991-4e0c-93bf-d4cbfaa0d808]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)
Nov 24 10:21:31 user nova-compute[75073]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)
Nov 24 10:21:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)
Nov 24 10:21:31 user nova-compute[75073]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)
Nov 24 10:21:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --login" returned: 0 in 0.194s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f107f1f-ba20-41bf-9c99-780e54c830fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]
Nov 24 10:21:32 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.
Nov 24 10:21:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:32 user nova-compute[75073]: INFO nova.compute.manager [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Took 10.85 seconds to build instance.
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00cb09-d182-4212-a664-278bf5c3f799]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8aa2411e-2d7d-4a04-9658-427de14acaa3 tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.086s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126fffa-515a-4188-bb27-62ad5b72139c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a431b0e2-b0f2-4018-9250-7a61296d63a8 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfd5adf-27b8-48cf-8eba-a5792e860e04 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:21:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.677s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.085s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19fc07-4171-47fe-9f6e-be4b0f514636]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.789s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== connect_volume: return (1792ms) {'type': 'block', 'scsi_wwn': '23537323234353436', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537323234353436', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1144101997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lazy-loading 'pci_devices' on Instance uuid ff8e177f-6cf4-4f93-b997-13ffacce99f1 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:21:33 user nova-compute[75073]:   <uuid>ff8e177f-6cf4-4f93-b997-13ffacce99f1</uuid>
Nov 24 10:21:33 user nova-compute[75073]:   <name>instance-00000007</name>
Nov 24 10:21:33 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:21:33 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:21:33 user nova-compute[75073]:   <metadata>
Nov 24 10:21:33 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:21:33 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:21:33 user nova-compute[75073]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1144101997</nova:name>
Nov 24 10:21:33 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:21:31</nova:creationTime>
Nov 24 10:21:33 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:21:33 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:21:33 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:21:33 user nova-compute[75073]:       <nova:owner>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:user uuid="92552b1336c84ed3a664b4e081c1ab19">tempest-ServerActionsV293TestJSON-834413643-project-member</nova:user>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:project uuid="b0d54989ce7c43ed9591752dfca4b618">tempest-ServerActionsV293TestJSON-834413643</nova:project>
Nov 24 10:21:33 user nova-compute[75073]:       </nova:owner>
Nov 24 10:21:33 user nova-compute[75073]:       <nova:ports>
Nov 24 10:21:33 user nova-compute[75073]:         <nova:port uuid="fcf31f42-7b47-49a6-be6a-83eda2801879">
Nov 24 10:21:33 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:21:33 user nova-compute[75073]:         </nova:port>
Nov 24 10:21:33 user nova-compute[75073]:       </nova:ports>
Nov 24 10:21:33 user nova-compute[75073]:     </nova:instance>
Nov 24 10:21:33 user nova-compute[75073]:   </metadata>
Nov 24 10:21:33 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:21:33 user nova-compute[75073]:     <system>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="serial">ff8e177f-6cf4-4f93-b997-13ffacce99f1</entry>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="uuid">ff8e177f-6cf4-4f93-b997-13ffacce99f1</entry>
Nov 24 10:21:33 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:21:33 user nova-compute[75073]:     </system>
Nov 24 10:21:33 user nova-compute[75073]:   </sysinfo>
Nov 24 10:21:33 user nova-compute[75073]:   <os>
Nov 24 10:21:33 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:21:33 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:21:33 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:21:33 user nova-compute[75073]:   </os>
Nov 24 10:21:33 user nova-compute[75073]:   <features>
Nov 24 10:21:33 user nova-compute[75073]:     <acpi/>
Nov 24 10:21:33 user nova-compute[75073]:     <apic/>
Nov 24 10:21:33 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:21:33 user nova-compute[75073]:   </features>
Nov 24 10:21:33 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:21:33 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:21:33 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:21:33 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:21:33 user nova-compute[75073]:   </clock>
Nov 24 10:21:33 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:21:33 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:21:33 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:21:33 user nova-compute[75073]:   </cpu>
Nov 24 10:21:33 user nova-compute[75073]:   <devices>
Nov 24 10:21:33 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:21:33 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:21:33 user nova-compute[75073]:       <source dev="/dev/sdd"/>
Nov 24 10:21:33 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:21:33 user nova-compute[75073]:       <serial>c219be38-d43f-46f2-b035-d18e8225d603</serial>
Nov 24 10:21:33 user nova-compute[75073]:     </disk>
Nov 24 10:21:33 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:21:33 user nova-compute[75073]:       <mac address="fa:16:3e:bf:c2:ed"/>
Nov 24 10:21:33 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:33 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:21:33 user nova-compute[75073]:       <target dev="tapfcf31f42-7b"/>
Nov 24 10:21:33 user nova-compute[75073]:     </interface>
Nov 24 10:21:33 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:21:33 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1/console.log" append="off"/>
Nov 24 10:21:33 user nova-compute[75073]:     </serial>
Nov 24 10:21:33 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:21:33 user nova-compute[75073]:     <video>
Nov 24 10:21:33 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:21:33 user nova-compute[75073]:     </video>
Nov 24 10:21:33 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:21:33 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:21:33 user nova-compute[75073]:     </rng>
Nov 24 10:21:33 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:21:33 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:21:33 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:21:33 user nova-compute[75073]:     </memballoon>
Nov 24 10:21:33 user nova-compute[75073]:   </devices>
Nov 24 10:21:33 user nova-compute[75073]: </domain>
Nov 24 10:21:33 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1144101997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG os_vif [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22c67f70-f642-5335-b3ba-28ea8781c6e3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf31f42-7b, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf31f42-7b, col_values=(('qos', UUID('955b025c-efc5-4b8f-adb7-072b888f139b')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf31f42-7b, col_values=(('external_ids', {'iface-id': 'fcf31f42-7b47-49a6-be6a-83eda2801879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c2:ed', 'vm-uuid': 'ff8e177f-6cf4-4f93-b997-13ffacce99f1'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:33 user nova-compute[75073]: INFO os_vif [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b')
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] No VIF found with MAC fa:16:3e:bf:c2:ed, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:36 user nova-compute[75073]: WARNING nova.compute.manager [req-1130c410-e372-4edf-a5d2-a636be38ff7f req-20a9d909-85e6-4397-8925-ed887ea0d82a service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state building and task_state spawning.
Nov 24 10:21:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:38 user nova-compute[75073]: WARNING nova.compute.manager [req-5751518a-7fa2-4de0-a034-19e856068130 req-a8653d98-c241-4660-9fab-14ad07ec538b service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state building and task_state spawning.
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance spawned successfully.
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:21:39 user nova-compute[75073]: INFO nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 24 10:21:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:39 user nova-compute[75073]: INFO nova.compute.manager [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Took 24.05 seconds to build instance.
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b03f7dc8-278d-45e6-968c-3f865e9a5626 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.382s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:41 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:41 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=25.803775787353516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8afebb27-fa78-48be-8750-a1d8141e10c9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fb7cefcf-9df1-4174-b68c-addb1af850a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:21:41 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.421s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.976s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:42 user nova-compute[75073]: INFO nova.compute.claims [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Claim successful on node user
Nov 24 10:21:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.186s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.453s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:21:43 user nova-compute[75073]: INFO nova.compute.claims [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Claim successful on node user
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:44 user nova-compute[75073]: INFO nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Booting with volume b1228142-a389-48f1-9a9d-0c340407741c at /dev/vda
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.policy [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbfafdd56da3418e87eb3ba113d35f73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bf1b653a4341c49a0b88456d6503e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eccbd4b-1116-4ec2-860e-83ff6126d263]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6281a21-457c-481e-861b-9a3c349e9ca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf70f0-ecc7-4d3f-8b9e-0834fa96a294]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d3fa0c-79f8-4ae2-8b1a-4c75d021430d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:44 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b8291-db50-45b4-93fc-d94a59cb4aac]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating existing volume attachment record: 0ff9f450-a91b-419d-8a06-c0b4549c97a7 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.036s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:21:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully created port: 166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:21:45 user nova-compute[75073]: INFO nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Booting with volume 13f77d9b-cddf-4ee9-a50e-9eed6b91d071 at /dev/vda
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.policy [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a60289fb34b4e3a88ac5537032ef8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac30811c254692a7412ca51bea9436', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c5577-ccdd-4f27-a3b8-2643dc2b4f5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72f5ec7-0f7d-437d-be38-d92eb9d9eff0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6f5e9e-9e72-4989-a8d5-8b48adfce16d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca408b38-bd8e-4d0a-938f-0e662d11063d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:21:45 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:21:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc28811a-4b69-4e9a-99c9-2f2cd40f94be]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:21:45 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating existing volume attachment record: 1c84f99f-296e-4e58-a172-f8aaa0ef14f6 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:21:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully created port: c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully created port: ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully created port: 86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully created port: bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully created port: c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully created port: eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully created port: 1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully created port: 7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: 166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-166c07a2-a845-45af-9ab2-a802a1696e3f. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:48 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port 166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:49 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:49 user nova-compute[75073]: DEBUG nova.network.neutron [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aea6b6bc-0031-4e19-8137-23a78149b6b0 req-0d5bc1b5-97f2-4cc2-830a-85d22d205b90 service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully created port: b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: 26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-26dabb9a-4c14-4982-ae42-8832cad5a681. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port 26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bf94826c-d9f7-496b-8878-605938b3f5fc req-5afb33dc-6cb9-47d5-bfa7-bb5055ae111c service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: 8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b81b3ca1-e951-438e-ab3a-a62579bdff8e req-5adbdc35-e638-44af-80a0-f2f5798cef2b service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-8397db81-f31d-490e-b032-84aeb250301a. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port 8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-c30151c6-9af0-4401-a4f9-00d7e7563e3a. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: 86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-be5a60bf-c604-4ad5-994f-a2e024bbfb91 req-8a853692-b30c-4238-860f-2c9857503cbf service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-c5e20246-0a7b-4710-8630-fb065eda2084. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d92f82-a1ec-40aa-a1a2-f1abcb48510f req-891ec92e-04e7-4b5b-a150-33038b247eb9 service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Successfully updated port: 1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-eab74823-ea8f-4e4d-922b-3949117b0a29. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-86471a41-2eb6-406f-a65e-c4f0d812c7d3. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: 7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f0425d2d-ddf4-4b12-a735-a56a9ad75464 req-ea4963ef-1853-44e6-8f06-5e96c9f8bbb4 service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Successfully updated port: b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-7e01face-a349-4681-a9e8-fabeef9fa35d. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.network.neutron [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:57 user nova-compute[75073]: WARNING nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state None.
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:57 user nova-compute[75073]: WARNING nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state None.
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] No waiting events found dispatching network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:57 user nova-compute[75073]: WARNING nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received unexpected event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 for instance with vm_state active and task_state None.
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] No waiting events found dispatching network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:21:57 user nova-compute[75073]: WARNING nova.compute.manager [req-1945b0ea-65d5-4f76-8a43-7692640d41b3 req-38083f62-536a-4ffd-af2b-97c2d97cd79b service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received unexpected event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 for instance with vm_state active and task_state None.
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance network_info: |[{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port 86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updated VIF entry in instance network info cache for port 86471a41-2eb6-406f-a65e-c4f0d812c7d3. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-c03e45e2-66db-49dc-a103-10aa73f45f16. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updated VIF entry in instance network info cache for port c03e45e2-66db-49dc-a103-10aa73f45f16. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-1377db28-8db1-41f1-a53c-01220dcc1163. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port 1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance network_info: |[{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port 7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updated VIF entry in instance network info cache for port 1377db28-8db1-41f1-a53c-01220dcc1163. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dabb7c87-cc95-4cc5-be8f-de6640f9be03 req-7b0e14a1-c045-4eb1-b0e7-951015d124af service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updated VIF entry in instance network info cache for port 7e01face-a349-4681-a9e8-fabeef9fa35d. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-b408c1cb-d580-43d7-ac6a-db948fb804db. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updated VIF entry in instance network info cache for port b408c1cb-d580-43d7-ac6a-db948fb804db. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:21:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0f7e28f9-2864-47b8-904d-d403b4742172 req-2fb5a3fd-4b75-4384-ad10-8b591d37b14b service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:00 user nova-compute[75073]: INFO nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Booting with volume 738ed1f1-ff40-4509-ac99-4880ae2abc59 at /dev/vdb
Nov 24 10:22:00 user nova-compute[75073]: INFO nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Booting with volume db902f4b-1a76-4f80-8452-686ef1ec49c2 at /dev/vdb
Nov 24 10:22:00 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ecef8-dd7c-4010-9433-0e4211606b31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4868ae5-6fc6-45c1-8be9-e1eeb5858ba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.075s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1358455-3e6c-4475-b39c-bfad9a82151f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.078s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5be201-aea1-4d41-82d3-0a0897bbc0ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c049b2-66e0-4dad-afa0-137984f7a425]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f54dd9-f0ac-426a-bd36-5cef9ecd1b98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221ec51-2bbe-4b5a-82ea-c8a6cf876569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1579ab-1f9e-4071-b7ce-9adbe74c8f8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:01 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fdc8d6-4c95-4cb6-9f10-dff00a084d12]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== get_connector_properties: return (260ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating existing volume attachment record: fe2cfd7f-8228-4ad4-b339-223f84407d80 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:01 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7b793e-3f3b-4240-92e3-f19898f19f08]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:01 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating existing volume attachment record: 39c1ddfb-c18a-4bcb-889b-242dbf79f78e {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:11 user nova-compute[75073]: INFO nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Booting with volume aea7df4b-8a5c-4eda-92d2-431e795cde5a at /dev/vdc
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81744bd-9966-46cd-b66b-a1bd105b147c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[64156b62-7346-4b8d-a20e-be13f6b21943]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a524927b-800f-4a4c-89a0-3df51e2b9dbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb831d-de52-465a-9234-e1192d6b3115]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:11 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d987d9-b244-4099-98af-bef20ef1af72]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG os_brick.utils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:11 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating existing volume attachment record: 11d0ce82-3460-4277-a6a9-b0827d65f762 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:12 user nova-compute[75073]: INFO nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Booting with volume 9a422a4c-8099-4c6b-87d0-b97795726b1e at /dev/vdc
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0521db-5d17-4a52-8ebb-dee41bd72ae4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[940360d3-a274-4135-88a3-26f88460d95b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771371a-194d-40c5-ac79-46eabd33965e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[346445f8-f4b3-423e-bbe9-d5394c97c32d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:12 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fa9d66-e08d-44d7-a784-49fafda5f09f]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:12 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating existing volume attachment record: 5bf14257-150d-4c4c-ba44-0a363045ea16 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:22:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Creating image(s)
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Ensure instance console log exists: /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Start _get_guest_xml network_info=[{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '1c84f99f-296e-4e58-a172-f8aaa0ef14f6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJlXGAOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7543d0e1-4197-4a0b-996d-0af2c4999288', 'attached_at': '', 'detached_at': '', 'volume_id': '13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 'serial': '13f77d9b-cddf-4ee9-a50e-9eed6b91d071'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '39c1ddfb-c18a-4bcb-889b-242dbf79f78e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrPYxmJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7543d0e1-4197-4a0b-996d-0af2c4999288', 'attached_at': '', 'detached_at': '', 'volume_id': 'db902f4b-1a76-4f80-8452-686ef1ec49c2', 'serial': 'db902f4b-1a76-4f80-8452-686ef1ec49c2'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '11d0ce82-3460-4277-a6a9-b0827d65f762', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPzSdxNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7543d0e1-4197-4a0b-996d-0af2c4999288', 'attached_at': '', 'detached_at': '', 'volume_id': 'aea7df4b-8a5c-4eda-92d2-431e795cde5a', 'serial': 'aea7df4b-8a5c-4eda-92d2-431e795cde5a'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:22:18 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:18 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJlXGAOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:18 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:18 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:18 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf74a16-5b2e-41eb-9668-08c8be99d2e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:18 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dfb2e9-04e8-490b-9686-4184679cd457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071] added
Nov 24 10:22:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc44dda-1afc-4390-ae16-d53b55d8766d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8655332d-3b07-446d-8d88-f9a145449a65]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJlXGAOx {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJlXGAOx" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51525d0c-ced6-4286-b472-cb1c027fe370]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aJlXGAOx'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb3597-2ab0-4728-9d0a-db2d17abf95b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f23bd7-5865-4e8c-8684-8ea09d6b1ebf]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[93027f83-48ba-4aef-8c13-73f3bcceb8f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260]
Nov 24 10:22:19 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419647f-0ee6-4185-a210-6804dd4ed864]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[88342bab-733b-4e23-b5a8-997b07407368]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc6d433-85e8-4312-a435-df9a2aa21b0e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJlXGAOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26637343266623036', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637343266623036', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrPYxmJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:20 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:20 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:20 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c146a47-338a-4bdb-8fae-882c9c7cc9eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:20 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d35c5-af32-4971-89ed-dc4f7d0eab48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2] added
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d42ff-6ed0-4c3b-9304-e5692a96e735]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeeb4fb-396d-45a2-969c-54cf01d6eb61]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrPYxmJs {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrPYxmJs" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3848e6-3fad-4e2a-b007-93e906cb0942]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrPYxmJs'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d96e3b0-ede7-4dfd-8e02-bb3941e970f4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ef7496-b648-4f66-83b0-2c58b9032419]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28058a7-ac8c-45ff-98e1-1541213b2925]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260]
Nov 24 10:22:20 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526068b-e713-4a1c-8941-6b407458f2a7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[70073d3e-6d20-418d-a14d-55c4cd3ec19b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a02100-a87e-4477-a145-8c32f33edc87]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrPYxmJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23464326337626363', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464326337626363', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPzSdxNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:21 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:21 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:21 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab4805-ffbf-47b5-b252-130eac08bed0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:21 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd1edc-a764-43be-b982-d4389ce780b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a] added
Nov 24 10:22:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5450f1-b017-453f-8c97-cb63935303fd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab1976-d28c-47cf-8595-bb14c9294004]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPzSdxNR {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPzSdxNR" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a304b4-3ed3-4afd-b75a-593790793175]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPzSdxNR'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4a2daf-739b-4f09-a7cb-2f3eca7b76d7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd149b08-ed99-4157-b790-e9bba3b50664]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d9af3-c2b8-49ea-8077-0c379625d699]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260]
Nov 24 10:22:22 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:22 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9df7a6-1330-4e53-a193-f199844b2469]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7309c4-4989-467d-b0c1-8a35e38f1541]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:22 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:22 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:22 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473a774-effe-4496-a28d-a679471023c3]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPzSdxNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26631646339646362', 'path': '/dev/sde'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631646339646362', 'path': '/dev/sde'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lazy-loading 'pci_devices' on Instance uuid 7543d0e1-4197-4a0b-996d-0af2c4999288 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:22:23 user nova-compute[75073]:   <uuid>7543d0e1-4197-4a0b-996d-0af2c4999288</uuid>
Nov 24 10:22:23 user nova-compute[75073]:   <name>instance-0000000a</name>
Nov 24 10:22:23 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:22:23 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:22:23 user nova-compute[75073]:   <metadata>
Nov 24 10:22:23 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:22:23 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:name>tempest-device-tagging-server-30671254</nova:name>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:22:18</nova:creationTime>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:22:23 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:22:23 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:owner>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:user uuid="9a60289fb34b4e3a88ac5537032ef8ab">tempest-TaggedBootDevicesTest-655101029-project-member</nova:user>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:project uuid="e3ac30811c254692a7412ca51bea9436">tempest-TaggedBootDevicesTest-655101029</nova:project>
Nov 24 10:22:23 user nova-compute[75073]:       </nova:owner>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:22:23 user nova-compute[75073]:       <nova:ports>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="ed85e937-5c71-4e7a-8235-4ddd4ec27ceb">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="8397db81-f31d-490e-b032-84aeb250301a">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="c30151c6-9af0-4401-a4f9-00d7e7563e3a">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="bfd2a6c0-c57a-49c3-90bc-f81114e0efd7">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="eab74823-ea8f-4e4d-922b-3949117b0a29">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="7e01face-a349-4681-a9e8-fabeef9fa35d">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:         <nova:port uuid="b408c1cb-d580-43d7-ac6a-db948fb804db">
Nov 24 10:22:23 user nova-compute[75073]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 24 10:22:23 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:23 user nova-compute[75073]:       </nova:ports>
Nov 24 10:22:23 user nova-compute[75073]:     </nova:instance>
Nov 24 10:22:23 user nova-compute[75073]:   </metadata>
Nov 24 10:22:23 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:22:23 user nova-compute[75073]:     <system>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="serial">7543d0e1-4197-4a0b-996d-0af2c4999288</entry>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="uuid">7543d0e1-4197-4a0b-996d-0af2c4999288</entry>
Nov 24 10:22:23 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:22:23 user nova-compute[75073]:     </system>
Nov 24 10:22:23 user nova-compute[75073]:   </sysinfo>
Nov 24 10:22:23 user nova-compute[75073]:   <os>
Nov 24 10:22:23 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:22:23 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:22:23 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:22:23 user nova-compute[75073]:   </os>
Nov 24 10:22:23 user nova-compute[75073]:   <features>
Nov 24 10:22:23 user nova-compute[75073]:     <acpi/>
Nov 24 10:22:23 user nova-compute[75073]:     <apic/>
Nov 24 10:22:23 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:22:23 user nova-compute[75073]:   </features>
Nov 24 10:22:23 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:22:23 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:22:23 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:22:23 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:22:23 user nova-compute[75073]:   </clock>
Nov 24 10:22:23 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:22:23 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:22:23 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:22:23 user nova-compute[75073]:   </cpu>
Nov 24 10:22:23 user nova-compute[75073]:   <devices>
Nov 24 10:22:23 user nova-compute[75073]:     <disk type="file" device="cdrom">
Nov 24 10:22:23 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 10:22:23 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/disk.config"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="hda" bus="ide"/>
Nov 24 10:22:23 user nova-compute[75073]:     </disk>
Nov 24 10:22:23 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:23 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:23 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <serial>13f77d9b-cddf-4ee9-a50e-9eed6b91d071</serial>
Nov 24 10:22:23 user nova-compute[75073]:     </disk>
Nov 24 10:22:23 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:23 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:23 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <serial>db902f4b-1a76-4f80-8452-686ef1ec49c2</serial>
Nov 24 10:22:23 user nova-compute[75073]:     </disk>
Nov 24 10:22:23 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:23 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:23 user nova-compute[75073]:       <source dev="/dev/sde"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="vdc" bus="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <serial>aea7df4b-8a5c-4eda-92d2-431e795cde5a</serial>
Nov 24 10:22:23 user nova-compute[75073]:     </disk>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:01:b4:9b"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="taped85e937-5c"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:72:3a:18"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tap8397db81-f3"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:d3:0b:2a"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tapc30151c6-9a"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:6c:a7:cc"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tapbfd2a6c0-c5"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:11:80:64"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tapeab74823-ea"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:bf:33:c9"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tap7e01face-a3"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:23 user nova-compute[75073]:       <mac address="fa:16:3e:8c:a4:96"/>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:23 user nova-compute[75073]:       <target dev="tapb408c1cb-d5"/>
Nov 24 10:22:23 user nova-compute[75073]:     </interface>
Nov 24 10:22:23 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:22:23 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/console.log" append="off"/>
Nov 24 10:22:23 user nova-compute[75073]:     </serial>
Nov 24 10:22:23 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:22:23 user nova-compute[75073]:     <video>
Nov 24 10:22:23 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:23 user nova-compute[75073]:     </video>
Nov 24 10:22:23 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:22:23 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:22:23 user nova-compute[75073]:     </rng>
Nov 24 10:22:23 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:22:23 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:22:23 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:22:23 user nova-compute[75073]:     </memballoon>
Nov 24 10:22:23 user nova-compute[75073]:   </devices>
Nov 24 10:22:23 user nova-compute[75073]: </domain>
Nov 24 10:22:23 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9d52922-2c1b-504f-8f8f-dc704a154d18', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped85e937-5c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped85e937-5c, col_values=(('qos', UUID('4368b8f2-9354-4c18-a778-2f9430abbc87')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped85e937-5c, col_values=(('external_ids', {'iface-id': 'ed85e937-5c71-4e7a-8235-4ddd4ec27ceb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:b4:9b', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df9d177a-f8b4-5f24-80ef-0c194334ca97', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8397db81-f3, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8397db81-f3, col_values=(('qos', UUID('a2f9a824-f637-4aa4-88af-1c7a47824886')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8397db81-f3, col_values=(('external_ids', {'iface-id': '8397db81-f31d-490e-b032-84aeb250301a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:3a:18', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b411336-60e8-5d90-be77-98c5b4c939e6', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc30151c6-9a, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc30151c6-9a, col_values=(('qos', UUID('02266f81-5157-446d-9f51-634b077f9918')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc30151c6-9a, col_values=(('external_ids', {'iface-id': 'c30151c6-9af0-4401-a4f9-00d7e7563e3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:0b:2a', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcbf27c0-5b66-55bd-a816-c213db75735a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfd2a6c0-c5, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfd2a6c0-c5, col_values=(('qos', UUID('d7a001ea-2c2f-43b9-a722-ed92f9b09b04')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfd2a6c0-c5, col_values=(('external_ids', {'iface-id': 'bfd2a6c0-c57a-49c3-90bc-f81114e0efd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a7:cc', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd81c92fc-784f-5da5-b453-b55a68b88b8d', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeab74823-ea, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeab74823-ea, col_values=(('qos', UUID('fc4556e7-0ae2-471f-902e-f953130c4e54')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeab74823-ea, col_values=(('external_ids', {'iface-id': 'eab74823-ea8f-4e4d-922b-3949117b0a29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:80:64', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a62955e0-6bb0-5905-ab93-106dac194a06', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e01face-a3, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e01face-a3, col_values=(('qos', UUID('aad8bd10-7398-45fd-a96f-6b0d8ff5b665')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e01face-a3, col_values=(('external_ids', {'iface-id': '7e01face-a349-4681-a9e8-fabeef9fa35d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:33:c9', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4a92288-023d-55b2-8069-25a619b5823e', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb408c1cb-d5, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb408c1cb-d5, col_values=(('qos', UUID('e96c43aa-cdb7-4811-afaf-02fe5bca18c0')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb408c1cb-d5, col_values=(('external_ids', {'iface-id': 'b408c1cb-d580-43d7-ac6a-db948fb804db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:a4:96', 'vm-uuid': '7543d0e1-4197-4a0b-996d-0af2c4999288'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:23 user nova-compute[75073]: INFO os_vif [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5')
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] No BDM found with device name hda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] No VIF found with MAC fa:16:3e:01:b4:9b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:22:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] No VIF found with MAC fa:16:3e:11:80:64, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:22:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Using config drive
Nov 24 10:22:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Creating config drive at /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/disk.config
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzlgjnkz2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzlgjnkz2" returned: 0 in 0.059s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:22:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Creating image(s)
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Ensure instance console log exists: /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Start _get_guest_xml network_info=[{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0ff9f450-a91b-419d-8a06-c0b4549c97a7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyzxmnBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8afebb27-fa78-48be-8750-a1d8141e10c9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1228142-a389-48f1-9a9d-0c340407741c', 'serial': 'b1228142-a389-48f1-9a9d-0c340407741c'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'fe2cfd7f-8228-4ad4-b339-223f84407d80', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgUwYcJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8afebb27-fa78-48be-8750-a1d8141e10c9', 'attached_at': '', 'detached_at': '', 'volume_id': '738ed1f1-ff40-4509-ac99-4880ae2abc59', 'serial': '738ed1f1-ff40-4509-ac99-4880ae2abc59'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5bf14257-150d-4c4c-ba44-0a363045ea16', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFfzEsDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8afebb27-fa78-48be-8750-a1d8141e10c9', 'attached_at': '', 'detached_at': '', 'volume_id': '9a422a4c-8099-4c6b-87d0-b97795726b1e', 'serial': '9a422a4c-8099-4c6b-87d0-b97795726b1e'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:22:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyzxmnBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:24 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:24 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:24 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c95c7-f2c4-4da5-97ee-373319048655]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:24 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79167e6a-1081-42bb-acc1-815b070ba01e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c] added
Nov 24 10:22:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb0ff2-5fec-481a-a98f-83856fdbc5bd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e883f5a-e7d2-4ea0-8fab-2dc87ef39dac]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyzxmnBw {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyzxmnBw" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057b1cb-f1dd-439e-898a-5be44c426584]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pyzxmnBw'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b842f2f7-cf95-4295-b1b0-00d9a51f0fd6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4eb32-3c66-45ab-8177-aa9fa753c33c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:24 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a04f7-5318-4f55-af81-665dce37c3f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260]
Nov 24 10:22:25 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8a876-ef58-4148-baa4-4c45303b493b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896e309-4d95-495c-bf54-0ed80ea1bcd1]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:25 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79137050-6f83-4e16-9883-1b8539255a5e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyzxmnBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:25 user nova-compute[75073]: WARNING nova.compute.manager [req-3281335c-32d9-47d0-8f04-c9d92c3fd21a req-c1d8b48c-018d-4a11-b1a5-9f176ec0526a service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb for instance with vm_state building and task_state spawning.
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '26362626334303564', 'path': '/dev/sdf'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362626334303564', 'path': '/dev/sdf'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgUwYcJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:26 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39bd05a-d762-4919-8035-f36da391972b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:26 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e720ae-8046-4855-91f8-54d9f4932542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59] added
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78dc0bd-e06b-4c36-91eb-0abcb8d497ab]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788989b-aa46-4449-a8ea-4db2fdd275b4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgUwYcJy {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgUwYcJy" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2383f39-3dde-4b0d-887f-e6c56ea44dd7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgUwYcJy'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff00683-e54c-4518-b11a-4b462fb60235]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f9531-7cd9-41f0-a558-08a66003803b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:26 user nova-compute[75073]: WARNING nova.compute.manager [req-a010dab9-8799-4f0d-83e4-9728c91facb2 req-7e034da4-cfa7-452a-ab5a-e5d848315e69 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a for instance with vm_state building and task_state spawning.
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd07e4-4ff9-4f21-b57a-ebd39c5c91dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260]
Nov 24 10:22:26 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9764451-4b54-4d1f-b544-ea38cf1dcf1a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b891d-6b4a-40cd-a7a7-5fef60cf74a7]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:26 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da5e39-a11e-4dc5-a75c-9c175b9f199a]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgUwYcJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:27 user nova-compute[75073]: WARNING nova.compute.manager [req-ca373403-46f6-4642-8413-68bf17fde68f req-df991ffe-c3c4-43a0-86d8-45bc3fb47da7 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 for instance with vm_state building and task_state spawning.
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26131363532613862', 'path': '/dev/sdg'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131363532613862', 'path': '/dev/sdg'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFfzEsDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:22:27 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c631415-40f5-4249-955b-016b8852b0d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:22:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fee86-b1ba-4ab3-a692-54f2a278a8b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e] added
Nov 24 10:22:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48862b44-1823-4fa3-baf6-5347dfd8493b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a16ea7-23db-4225-b471-f9fc6d5759ca]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFfzEsDy {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFfzEsDy" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df89da43-ec72-4e36-b4f3-451695745e36]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFfzEsDy'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7650a4-b469-48aa-857d-72f60d0caa78]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-eac4f270-1060-4936-9168-2de09ce6cecd req-e0ac4a4e-124b-4e1d-9efe-3c94c6b7fb41 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7346733-2549-4991-8f4d-104d75e75321]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54ce28-44ac-4b8e-bab3-6d15d1a78bb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260]
Nov 24 10:22:28 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260] successful.
Nov 24 10:22:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a46bf7-5c7c-4962-929b-eb5b45ce5161]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[73324286-aec4-4e5c-899f-bdee09a4271f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:22:28 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:22:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e1bb1e-7c83-495c-bd6b-31b07535b577]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFfzEsDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d for instance with vm_state building and task_state spawning.
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:28 user nova-compute[75073]: WARNING nova.compute.manager [req-52cf77d9-c6c7-4d39-a7b7-5e098e3e951e req-8e81407e-3c11-40b7-9aec-f11e53716bce service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d for instance with vm_state building and task_state spawning.
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:29 user nova-compute[75073]: WARNING nova.compute.manager [req-1eba31ef-c052-48fa-a2bf-dbc16cd89a8a req-e8ae163c-c6a7-4495-ac61-795f80166f49 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 for instance with vm_state building and task_state spawning.
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26330343131643165', 'path': '/dev/sdh'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330343131643165', 'path': '/dev/sdh'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lazy-loading 'pci_devices' on Instance uuid 8afebb27-fa78-48be-8750-a1d8141e10c9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:22:29 user nova-compute[75073]:   <uuid>8afebb27-fa78-48be-8750-a1d8141e10c9</uuid>
Nov 24 10:22:29 user nova-compute[75073]:   <name>instance-00000009</name>
Nov 24 10:22:29 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:22:29 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:22:29 user nova-compute[75073]:   <metadata>
Nov 24 10:22:29 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:22:29 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:name>tempest-device-tagging-server-323054804</nova:name>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:22:24</nova:creationTime>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:22:29 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:22:29 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:owner>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:user uuid="fbfafdd56da3418e87eb3ba113d35f73">tempest-TaggedBootDevicesTest_v242-263582714-project-member</nova:user>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:project uuid="61bf1b653a4341c49a0b88456d6503e4">tempest-TaggedBootDevicesTest_v242-263582714</nova:project>
Nov 24 10:22:29 user nova-compute[75073]:       </nova:owner>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:22:29 user nova-compute[75073]:       <nova:ports>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="166c07a2-a845-45af-9ab2-a802a1696e3f">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="26dabb9a-4c14-4982-ae42-8832cad5a681">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.110" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="c5e20246-0a7b-4710-8630-fb065eda2084">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="86471a41-2eb6-406f-a65e-c4f0d812c7d3">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="c03e45e2-66db-49dc-a103-10aa73f45f16">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:         <nova:port uuid="1377db28-8db1-41f1-a53c-01220dcc1163">
Nov 24 10:22:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 24 10:22:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:29 user nova-compute[75073]:       </nova:ports>
Nov 24 10:22:29 user nova-compute[75073]:     </nova:instance>
Nov 24 10:22:29 user nova-compute[75073]:   </metadata>
Nov 24 10:22:29 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:22:29 user nova-compute[75073]:     <system>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="serial">8afebb27-fa78-48be-8750-a1d8141e10c9</entry>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="uuid">8afebb27-fa78-48be-8750-a1d8141e10c9</entry>
Nov 24 10:22:29 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:22:29 user nova-compute[75073]:     </system>
Nov 24 10:22:29 user nova-compute[75073]:   </sysinfo>
Nov 24 10:22:29 user nova-compute[75073]:   <os>
Nov 24 10:22:29 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:22:29 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:22:29 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:22:29 user nova-compute[75073]:   </os>
Nov 24 10:22:29 user nova-compute[75073]:   <features>
Nov 24 10:22:29 user nova-compute[75073]:     <acpi/>
Nov 24 10:22:29 user nova-compute[75073]:     <apic/>
Nov 24 10:22:29 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:22:29 user nova-compute[75073]:   </features>
Nov 24 10:22:29 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:22:29 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:22:29 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:22:29 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:22:29 user nova-compute[75073]:   </clock>
Nov 24 10:22:29 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:22:29 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:22:29 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:22:29 user nova-compute[75073]:   </cpu>
Nov 24 10:22:29 user nova-compute[75073]:   <devices>
Nov 24 10:22:29 user nova-compute[75073]:     <disk type="file" device="cdrom">
Nov 24 10:22:29 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 10:22:29 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/disk.config"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="hda" bus="ide"/>
Nov 24 10:22:29 user nova-compute[75073]:     </disk>
Nov 24 10:22:29 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:29 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:29 user nova-compute[75073]:       <source dev="/dev/sdf"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <serial>b1228142-a389-48f1-9a9d-0c340407741c</serial>
Nov 24 10:22:29 user nova-compute[75073]:     </disk>
Nov 24 10:22:29 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:29 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:29 user nova-compute[75073]:       <source dev="/dev/sdg"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <serial>738ed1f1-ff40-4509-ac99-4880ae2abc59</serial>
Nov 24 10:22:29 user nova-compute[75073]:     </disk>
Nov 24 10:22:29 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:22:29 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:22:29 user nova-compute[75073]:       <source dev="/dev/sdh"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="vdc" bus="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <serial>9a422a4c-8099-4c6b-87d0-b97795726b1e</serial>
Nov 24 10:22:29 user nova-compute[75073]:     </disk>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:97:07:4b"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tap166c07a2-a8"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:ff:c5:37"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tap26dabb9a-4c"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:04:c0:d4"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tapdcb05e47-1e"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:07:5b:3f"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tapc5e20246-0a"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:53:70:70"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tap86471a41-2e"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:1f:55:d5"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tapc03e45e2-66"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:29 user nova-compute[75073]:       <mac address="fa:16:3e:a1:38:4c"/>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:29 user nova-compute[75073]:       <target dev="tap1377db28-8d"/>
Nov 24 10:22:29 user nova-compute[75073]:     </interface>
Nov 24 10:22:29 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:22:29 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/console.log" append="off"/>
Nov 24 10:22:29 user nova-compute[75073]:     </serial>
Nov 24 10:22:29 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:22:29 user nova-compute[75073]:     <video>
Nov 24 10:22:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:29 user nova-compute[75073]:     </video>
Nov 24 10:22:29 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:22:29 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:22:29 user nova-compute[75073]:     </rng>
Nov 24 10:22:29 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:22:29 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:22:29 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:22:29 user nova-compute[75073]:     </memballoon>
Nov 24 10:22:29 user nova-compute[75073]:   </devices>
Nov 24 10:22:29 user nova-compute[75073]: </domain>
Nov 24 10:22:29 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e01fca4-654f-569f-ae99-3e729219ba0a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166c07a2-a8, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166c07a2-a8, col_values=(('qos', UUID('f5c3115d-6aa5-4373-9338-d64580ccc16d')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166c07a2-a8, col_values=(('external_ids', {'iface-id': '166c07a2-a845-45af-9ab2-a802a1696e3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:07:4b', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ee574fe-665e-5d42-bc72-5c42e2c7459f', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dabb9a-4c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dabb9a-4c, col_values=(('qos', UUID('078145e1-1489-48f3-9739-39fc5a5dae68')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dabb9a-4c, col_values=(('external_ids', {'iface-id': '26dabb9a-4c14-4982-ae42-8832cad5a681', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:c5:37', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2e767e9-91fa-5949-8d12-a5c8939fa4fd', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcb05e47-1e, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcb05e47-1e, col_values=(('qos', UUID('3f780209-5e1a-4472-9e93-f8da3d295d8d')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcb05e47-1e, col_values=(('external_ids', {'iface-id': 'dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:c0:d4', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffbac009-fff9-59ff-a730-0b7550c223f0', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e20246-0a, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5e20246-0a, col_values=(('qos', UUID('8ab19c51-4b19-4b4a-a968-86ca53431a43')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5e20246-0a, col_values=(('external_ids', {'iface-id': 'c5e20246-0a7b-4710-8630-fb065eda2084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:5b:3f', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e9703f-1154-5671-b055-eca28de80317', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86471a41-2e, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86471a41-2e, col_values=(('qos', UUID('8690218d-a0d2-4993-8d77-2f2b46b7bf0a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86471a41-2e, col_values=(('external_ids', {'iface-id': '86471a41-2eb6-406f-a65e-c4f0d812c7d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:70:70', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7618c9c5-5008-555b-bbb5-4f69ec7951c3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc03e45e2-66, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc03e45e2-66, col_values=(('qos', UUID('7c4bd073-38a0-44b8-9a96-53457a541233')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc03e45e2-66, col_values=(('external_ids', {'iface-id': 'c03e45e2-66db-49dc-a103-10aa73f45f16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:55:d5', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66')
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4eb93557-4885-53b2-a428-c0d4897e3bb2', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1377db28-8d, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1377db28-8d, col_values=(('qos', UUID('d0fd44cf-1fcb-44d7-b01c-e3b206e81b75')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1377db28-8d, col_values=(('external_ids', {'iface-id': '1377db28-8db1-41f1-a53c-01220dcc1163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:38:4c', 'vm-uuid': '8afebb27-fa78-48be-8750-a1d8141e10c9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:30 user nova-compute[75073]: WARNING nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db for instance with vm_state building and task_state spawning.
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:30 user nova-compute[75073]: WARNING nova.compute.manager [req-967d49eb-9e5e-4f47-9505-bab931362f42 req-cc3e05b4-6bd1-4010-b2b6-7676a94bd956 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db for instance with vm_state building and task_state spawning.
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:30 user nova-compute[75073]: INFO os_vif [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d')
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] No BDM found with device name hda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] No VIF found with MAC fa:16:3e:97:07:4b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] No VIF found with MAC fa:16:3e:53:70:70, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:22:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Using config drive
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:22:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance spawned successfully.
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:30 user nova-compute[75073]: INFO nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Took 11.54 seconds to spawn the instance on the hypervisor.
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:22:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Creating config drive at /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/disk.config
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8q4qxmpk {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8q4qxmpk" returned: 0 in 0.065s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:30 user nova-compute[75073]: INFO nova.compute.manager [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Took 47.47 seconds to build instance.
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d5cac26f-4905-41c4-8e26-ef2da451bd17 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.981s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:22:30 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:22:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:22:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:22:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:32 user nova-compute[75073]: WARNING nova.compute.manager [req-da29f814-6bbc-487f-8c5e-c87c6f22aa50 req-02cd49b5-9e11-489d-8db3-1a4572f222ad service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f for instance with vm_state building and task_state spawning.
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:32 user nova-compute[75073]: WARNING nova.compute.manager [req-09d36d34-27e5-492f-85d1-4aaed1f9f91c req-fb96dee1-fbf9-4ad7-90b0-c7f8d65d4446 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 for instance with vm_state building and task_state spawning.
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:33 user nova-compute[75073]: WARNING nova.compute.manager [req-135a9b44-e987-4716-b07f-8c9683053f92 req-ec74019d-9cf1-47df-b42e-8f145fd7aa2a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 for instance with vm_state building and task_state spawning.
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:34 user nova-compute[75073]: WARNING nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f for instance with vm_state building and task_state spawning.
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:34 user nova-compute[75073]: WARNING nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 for instance with vm_state building and task_state spawning.
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:34 user nova-compute[75073]: WARNING nova.compute.manager [req-de42889a-72a7-41b1-8e1d-16c61590f65c req-7d14a439-585f-451d-a1ec-18548a7e150b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 for instance with vm_state building and task_state spawning.
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:34 user nova-compute[75073]: WARNING nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 for instance with vm_state building and task_state spawning.
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:34 user nova-compute[75073]: WARNING nova.compute.manager [req-713ccb56-10c6-4645-950b-25d96d649bd6 req-4a775b99-191b-48b0-881b-fc3ab17f0bb7 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 for instance with vm_state building and task_state spawning.
Nov 24 10:22:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:35 user nova-compute[75073]: WARNING nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 for instance with vm_state building and task_state spawning.
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:35 user nova-compute[75073]: WARNING nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 for instance with vm_state building and task_state spawning.
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:35 user nova-compute[75073]: WARNING nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 for instance with vm_state building and task_state spawning.
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:35 user nova-compute[75073]: WARNING nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 for instance with vm_state building and task_state spawning.
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:35 user nova-compute[75073]: WARNING nova.compute.manager [req-15cd0881-7a97-440e-a716-68d1c0c8f040 req-ee1635ba-192c-4919-81b4-0e743f25039a service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 for instance with vm_state building and task_state spawning.
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:36 user nova-compute[75073]: INFO nova.compute.manager [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Rescuing
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:36 user nova-compute[75073]: WARNING nova.compute.manager [req-d9837a6e-34d1-447e-8bc5-e5c17689862a req-33c2c2da-ae41-4df5-8bdd-8612a318a87f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 for instance with vm_state building and task_state spawning.
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance spawned successfully.
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Took 12.79 seconds to spawn the instance on the hypervisor.
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:37 user nova-compute[75073]: WARNING nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:37 user nova-compute[75073]: WARNING nova.compute.manager [req-c62edfac-c24f-4068-95f1-0463581a4b05 req-eadc0aca-a9ae-454a-bc2e-d6eef206542f service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.compute.manager [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Took 56.37 seconds to build instance.
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-70d04452-72f9-4de1-b0f1-ab4e5e02f2d8 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.319s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance destroyed successfully.
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Attempting rescue
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:22:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Creating image(s)
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'trusted_certs' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.275s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue" returned: 0 in 0.055s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'migration_context' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<ccb126e6-2e9f-400e-9351-8183056a5410> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start _get_guest_xml network_info=[{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:1e:76:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<ccb126e6-2e9f-400e-9351-8183056a5410> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'numa_topology' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<ccb126e6-2e9f-400e-9351-8183056a5410> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:22:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'vcpu_model' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<ccb126e6-2e9f-400e-9351-8183056a5410> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-702734092',display_name='tempest-ServerRescueNegativeTestJSON-server-702734092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-702734092',id=2,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-76dwo0cl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:01Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=ccb126e6-2e9f-400e-9351-8183056a5410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:1e:76:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:1e:76:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<ccb126e6-2e9f-400e-9351-8183056a5410> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:22:38 user nova-compute[75073]:   <uuid>ccb126e6-2e9f-400e-9351-8183056a5410</uuid>
Nov 24 10:22:38 user nova-compute[75073]:   <name>instance-00000002</name>
Nov 24 10:22:38 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:22:38 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:22:38 user nova-compute[75073]:   <metadata>
Nov 24 10:22:38 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:22:38 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-702734092</nova:name>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:22:38</nova:creationTime>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:22:38 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:22:38 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:owner>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:22:38 user nova-compute[75073]:       </nova:owner>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:22:38 user nova-compute[75073]:       <nova:ports>
Nov 24 10:22:38 user nova-compute[75073]:         <nova:port uuid="f4541341-e046-4363-ae69-dc00b3ce4f03">
Nov 24 10:22:38 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:22:38 user nova-compute[75073]:         </nova:port>
Nov 24 10:22:38 user nova-compute[75073]:       </nova:ports>
Nov 24 10:22:38 user nova-compute[75073]:     </nova:instance>
Nov 24 10:22:38 user nova-compute[75073]:   </metadata>
Nov 24 10:22:38 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:22:38 user nova-compute[75073]:     <system>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="serial">ccb126e6-2e9f-400e-9351-8183056a5410</entry>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="uuid">ccb126e6-2e9f-400e-9351-8183056a5410</entry>
Nov 24 10:22:38 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:22:38 user nova-compute[75073]:     </system>
Nov 24 10:22:38 user nova-compute[75073]:   </sysinfo>
Nov 24 10:22:38 user nova-compute[75073]:   <os>
Nov 24 10:22:38 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:22:38 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:22:38 user nova-compute[75073]:   </os>
Nov 24 10:22:38 user nova-compute[75073]:   <features>
Nov 24 10:22:38 user nova-compute[75073]:     <acpi/>
Nov 24 10:22:38 user nova-compute[75073]:     <apic/>
Nov 24 10:22:38 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:22:38 user nova-compute[75073]:   </features>
Nov 24 10:22:38 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:22:38 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:22:38 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:22:38 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:22:38 user nova-compute[75073]:   </clock>
Nov 24 10:22:38 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:22:38 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:22:38 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:22:38 user nova-compute[75073]:   </cpu>
Nov 24 10:22:38 user nova-compute[75073]:   <devices>
Nov 24 10:22:38 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:22:38 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:22:38 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue"/>
Nov 24 10:22:38 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:22:38 user nova-compute[75073]:     </disk>
Nov 24 10:22:38 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:22:38 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:22:38 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk"/>
Nov 24 10:22:38 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:22:38 user nova-compute[75073]:     </disk>
Nov 24 10:22:38 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:22:38 user nova-compute[75073]:       <mac address="fa:16:3e:1e:76:dc"/>
Nov 24 10:22:38 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:38 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:22:38 user nova-compute[75073]:       <target dev="tapf4541341-e0"/>
Nov 24 10:22:38 user nova-compute[75073]:     </interface>
Nov 24 10:22:38 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:22:38 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/console.log" append="off"/>
Nov 24 10:22:38 user nova-compute[75073]:     </serial>
Nov 24 10:22:38 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:22:38 user nova-compute[75073]:     <video>
Nov 24 10:22:38 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:22:38 user nova-compute[75073]:     </video>
Nov 24 10:22:38 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:22:38 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:22:38 user nova-compute[75073]:     </rng>
Nov 24 10:22:38 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:22:38 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:22:38 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:22:38 user nova-compute[75073]:     </memballoon>
Nov 24 10:22:38 user nova-compute[75073]:   </devices>
Nov 24 10:22:38 user nova-compute[75073]: </domain>
Nov 24 10:22:38 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance destroyed successfully.
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:1e:76:dc, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:22:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7222MB free_disk=25.638591766357422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fb7cefcf-9df1-4174-b68c-addb1af850a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8afebb27-fa78-48be-8750-a1d8141e10c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 7543d0e1-4197-4a0b-996d-0af2c4999288 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:39 user nova-compute[75073]: WARNING nova.compute.manager [req-ea885992-87a8-4907-824f-f4238867653a req-8d154c26-cc6c-4814-9f2c-26b4db531689 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:22:39 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:41 user nova-compute[75073]: WARNING nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:22:41 user nova-compute[75073]: WARNING nova.compute.manager [req-a4643408-3775-4256-8230-4cb8b82ff2eb req-6bfdef7b-c842-420e-9c43-9223858f2649 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state active and task_state rescuing.
Nov 24 10:22:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-4a67a1a7-5ae4-40b5-979a-bc2ab4c1c62c tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:22:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-changed-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Refreshing instance network info cache due to event network-changed-4b42b912-6f43-459a-8b4f-09678aa5d133. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:22:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] Acquiring lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:22:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] Acquired lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:22:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Refreshing network info cache for port 4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updated VIF entry in instance network info cache for port 4b42b912-6f43-459a-8b4f-09678aa5d133. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating instance_info_cache with network_info: [{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fefd532d-590e-4306-83c8-75928ec4f1b0 req-f066161d-0dee-44d4-aac9-bf25d7635cda service nova] Releasing lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG nova.objects.instance [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lazy-loading 'flavor' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:53 user nova-compute[75073]: INFO nova.compute.manager [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attaching volume 2064dc83-8441-4f54-bc65-3d63b47f23f1 to /dev/vdb
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.utils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77967c8-2b24-4046-bfc2-0bfb18542a7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e72d60f-ceb8-4dc9-8af3-29d047149222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a6164-054d-440b-a078-66f82ea4a633]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a9911-ccf0-44b0-96c8-11d4713abe58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:53 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca6a8f-fe6c-4ab5-aa56-2ae45e699598]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG os_brick.utils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating existing volume attachment record: 682bbacd-eaea-4f4e-a8ba-a5e4ff49e2a0 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-changed-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Refreshing instance network info cache due to event network-changed-748ee9e7-1f70-41a7-9e50-fb8e09a501ff. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] Acquiring lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] Acquired lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:22:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Refreshing network info cache for port 748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:22:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updated VIF entry in instance network info cache for port 748ee9e7-1f70-41a7-9e50-fb8e09a501ff. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:22:54 user nova-compute[75073]: DEBUG nova.network.neutron [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating instance_info_cache with network_info: [{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:22:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e4312c19-1f28-44b5-a296-c65014e8e276 req-2faf985a-564f-4e46-a72d-7456d006a320 service nova] Releasing lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'flavor' on Instance uuid facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:22:56 user nova-compute[75073]: INFO nova.compute.manager [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Attaching volume 969af41e-fe79-43fd-84de-ac56899c860c to /dev/vdb
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.utils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f2c997-9795-49bd-bbe4-080dcf5202e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62266145-9494-4e32-81a5-a329e2c2f00d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[81680fba-90b2-4dc9-b51a-81a0b4650bb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cda506-235d-4c3f-9e23-b01f3990f7f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:22:56 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:22:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aefe103-a224-4d2b-a91b-b2841d385d08]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG os_brick.utils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:22:56 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating existing volume attachment record: 258afb29-ad48-45a1-916e-11f92bed6467 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:22:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-changed-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:22:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Refreshing instance network info cache due to event network-changed-2960f7ca-09c6-490e-95b0-5de751a66fee. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:22:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] Acquiring lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:22:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] Acquired lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:22:59 user nova-compute[75073]: DEBUG nova.network.neutron [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Refreshing network info cache for port 2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:00 user nova-compute[75073]: DEBUG nova.network.neutron [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updated VIF entry in instance network info cache for port 2960f7ca-09c6-490e-95b0-5de751a66fee. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:00 user nova-compute[75073]: DEBUG nova.network.neutron [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updating instance_info_cache with network_info: [{"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d2c5f3de-5aeb-403b-baac-d03a20dece6d req-4982d5b8-eabc-462a-8ae8-0cd89335d652 service nova] Releasing lock "refresh_cache-fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:01 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:01 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:01 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96633ba-404f-45c6-9c64-55ca3406f436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:01 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fae925-620f-456b-add3-7a56a44ce332]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1] added
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae4b0d-1248-4b23-83d9-1c8b3e947341]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b1e20-939b-4236-ae8a-ccec4de92ce2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJUgNYXI {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJUgNYXI" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7a516-d9a5-45f4-ad9f-0495c402848d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJUgNYXI'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4131e593-370a-4cc4-b91d-6bfacb5a07c1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15fc130-2ad2-4464-b7f0-0967d642d2d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f31b5-2556-4db8-b1b2-636a67bd128c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]
Nov 24 10:23:01 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83ac1f-4a9f-4be2-869b-c887894096d8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9b59f-d69f-4fa2-b837-690d612cc411]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:01 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[80620f05-645f-4fa4-b7ca-8416e210e636]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23334663561626131', 'path': '/dev/sdi'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334663561626131', 'path': '/dev/sdi'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lazy-loading 'flavor' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:23:02 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:02 user nova-compute[75073]:   <source dev="/dev/sdi"/>
Nov 24 10:23:02 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:02 user nova-compute[75073]:   <serial>2064dc83-8441-4f54-bc65-3d63b47f23f1</serial>
Nov 24 10:23:02 user nova-compute[75073]: </disk>
Nov 24 10:23:02 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lazy-loading 'flavor' on Instance uuid fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:03 user nova-compute[75073]: INFO nova.compute.manager [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Attaching volume f088f44b-a133-4a8f-87e5-2be2d116f326 to /dev/sdc
Nov 24 10:23:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] No VIF found with MAC fa:16:3e:94:60:6b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.utils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672753b-7ba3-4862-8caa-75f35c5e3c93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ad64f-c70d-417f-bea4-b4a55184fae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d4535-9b6f-43c8-8472-8837de7a5be4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ef1886-e378-4b2b-b381-4e3448ffa70b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb2bc6bb-a108-484c-8100-2ed0f9aebb1a tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.160s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:03 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b96b92-e3b6-47d9-9d4a-c6140e54d428]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG os_brick.utils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:03 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updating existing volume attachment record: 20383722-0508-4f63-9737-8b37f3e2ab8a {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-changed-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing instance network info cache due to event network-changed-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing network info cache for port ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.utils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad02e32-38ad-4a2c-86c1-ca7eac5df324]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6148658-1600-477f-804c-5781c4af7da4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a2247-308a-424c-9739-5e9c397cb354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[569915c0-e426-46a1-8bf9-b9f4daec411b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:04 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ede56f9-4eef-4898-84ec-a0fa3a3fb9e9]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:04 user nova-compute[75073]: DEBUG os_brick.utils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:05 user nova-compute[75073]: INFO nova.compute.manager [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Swapping volume 2064dc83-8441-4f54-bc65-3d63b47f23f1 for 5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'pci_requests' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.objects.base [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Object Instance<b745dbf9-0dc2-4d1a-b709-d48422e9a537> lazy-loaded attributes: flavor,pci_requests {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updated VIF entry in instance network info cache for port ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ced6172-1fab-4956-86ad-26e39c466b94 req-f7fb699e-7b7a-490f-9ee2-ab8e7efd775a service nova] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG nova.policy [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb6e6c16c4c4638a91632bee60f3bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdeb11f3d47f45c7a467c206134af82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:23:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Successfully created port: 14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-changed-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Refreshing instance network info cache due to event network-changed-fcf31f42-7b47-49a6-be6a-83eda2801879. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] Acquiring lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] Acquired lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.network.neutron [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Refreshing network info cache for port fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Successfully updated port: 14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-changed-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing instance network info cache due to event network-changed-14dead6a-e61b-4e0b-bf98-8e724992bbb7. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:23:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updated VIF entry in instance network info cache for port fcf31f42-7b47-49a6-be6a-83eda2801879. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating instance_info_cache with network_info: [{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1fae4bec-96be-408b-80fb-74b6cd542285 req-797457d4-896a-4076-a030-4adae3ed5ec6 service nova] Releasing lock "refresh_cache-ff8e177f-6cf4-4f93-b997-13ffacce99f1" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Refreshing network info cache for port 14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG os_vif [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f197966-a0d2-51f2-b9d2-f906f2d10b16', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14dead6a-e6, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14dead6a-e6, col_values=(('qos', UUID('35653c0e-b817-44ef-b1cd-4890ca25f47a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14dead6a-e6, col_values=(('external_ids', {'iface-id': '14dead6a-e61b-4e0b-bf98-8e724992bbb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:22:38', 'vm-uuid': 'b745dbf9-0dc2-4d1a-b709-d48422e9a537'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: INFO os_vif [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6')
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] attach device xml: <interface type="ethernet">
Nov 24 10:23:07 user nova-compute[75073]:   <mac address="fa:16:3e:bf:22:38"/>
Nov 24 10:23:07 user nova-compute[75073]:   <model type="virtio"/>
Nov 24 10:23:07 user nova-compute[75073]:   <mtu size="1442"/>
Nov 24 10:23:07 user nova-compute[75073]:   <target dev="tap14dead6a-e6"/>
Nov 24 10:23:07 user nova-compute[75073]: </interface>
Nov 24 10:23:07 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name hda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No VIF found with MAC fa:16:3e:74:6e:7f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:23:08 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:23:08</nova:creationTime>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:23:08 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:23:08 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:owner>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:23:08 user nova-compute[75073]:   </nova:owner>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:23:08 user nova-compute[75073]:   <nova:ports>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:23:08 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:23:08 user nova-compute[75073]:     </nova:port>
Nov 24 10:23:08 user nova-compute[75073]:     <nova:port uuid="14dead6a-e61b-4e0b-bf98-8e724992bbb7">
Nov 24 10:23:08 user nova-compute[75073]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Nov 24 10:23:08 user nova-compute[75073]:     </nova:port>
Nov 24 10:23:08 user nova-compute[75073]:   </nova:ports>
Nov 24 10:23:08 user nova-compute[75073]: </nova:instance>
Nov 24 10:23:08 user nova-compute[75073]:  {{(pid=75073) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updated VIF entry in instance network info cache for port 14dead6a-e61b-4e0b-bf98-8e724992bbb7. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0b399e57-c212-4505-a890-cd963cfb6f6b tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.248s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fab8405d-15a5-4367-9582-071d812e0343 req-b88a2497-0660-4990-8e0a-ea4d354a7057 service nova] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:09 user nova-compute[75073]: WARNING nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 for instance with vm_state active and task_state None.
Nov 24 10:23:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:09 user nova-compute[75073]: WARNING nova.compute.manager [req-8b1c2000-1edc-491b-9a1d-a34fb272ddef req-5b13651b-e564-437e-aa80-dbbad06eafff service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 for instance with vm_state active and task_state None.
Nov 24 10:23:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKHiastR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:10 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:10 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:10 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7b338-16af-4eef-917e-46694c098733]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:10 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b851fdb-52c8-4a3d-8e05-933d1bc39c60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326] added
Nov 24 10:23:10 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47832a2-7f0d-4f3a-a9aa-f6cdba7e4450]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e43ff-6a7e-4698-aa57-8b22b160406a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKHiastR {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKHiastR" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eec56d-043e-4a42-84c3-fca31bd58c68]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QKHiastR'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea8c08d-e9bb-4f93-9adb-0bd562897792]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad30a6-5ace-4aee-a183-6b7abf24ad72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:10 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:10 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-changed-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Refreshing instance network info cache due to event network-changed-36c78c3f-e3c0-471c-b502-e3441b678fae. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] Acquiring lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] Acquired lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG nova.network.neutron [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Refreshing network info cache for port 36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[457eff1f-7921-4b9f-a78a-38c493d2da02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260]
Nov 24 10:23:10 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:10 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10ab13-125e-4170-aa6e-50bf16af0b52]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[521befce-e604-400d-97d0-23387ef0206c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:11 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[794dc2b8-a7c1-410e-92ad-8a10f0bbe118]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKHiastR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG nova.network.neutron [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updated VIF entry in instance network info cache for port 36c78c3f-e3c0-471c-b502-e3441b678fae. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG nova.network.neutron [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating instance_info_cache with network_info: [{"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-357d93bc-27c9-4c97-82a6-2327f90ed0e4 req-2d907f8b-c07a-4ddd-ad71-cb2cd761a0ef service nova] Releasing lock "refresh_cache-9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lazy-loading 'flavor' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:11 user nova-compute[75073]: INFO nova.compute.manager [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Attaching volume e56e1dda-4b07-401a-9cfa-72e9b1908f9e to /dev/vdb
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26537386635373433', 'path': '/dev/sdj'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537386635373433', 'path': '/dev/sdj'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:12 user nova-compute[75073]: INFO nova.compute.manager [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Attaching volume cd438934-60aa-408f-9357-55a3fddddb18 to /dev/vdb
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lazy-loading 'flavor' on Instance uuid fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:12 user nova-compute[75073]: INFO nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Rebuilding instance
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:23:12 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:12 user nova-compute[75073]:   <source dev="/dev/sdj"/>
Nov 24 10:23:12 user nova-compute[75073]:   <target dev="sdc" bus="scsi"/>
Nov 24 10:23:12 user nova-compute[75073]:   <serial>f088f44b-a133-4a8f-87e5-2be2d116f326</serial>
Nov 24 10:23:12 user nova-compute[75073]:   <address type="drive" controller="0" unit="2"/>
Nov 24 10:23:12 user nova-compute[75073]: </disk>
Nov 24 10:23:12 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d4ec05-f025-4e4d-aeeb-d72210b7b2af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe801a4-42bb-401c-b29f-0c2ecdd560da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f431811-91e2-4faf-b2c2-d3131f6997a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa64fad-fb6c-4598-9628-f1f9551a8ef0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[047ce3a0-3289-4783-a359-735008e51463]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:12 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38518388-24df-469d-9cd7-e42f29d2b571]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating existing volume attachment record: d56fdd8f-4606-46e0-b204-10ea011f94e9 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950fc2c-14a3-4458-9a4b-e05fabeb2768]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c465a74-9420-4684-9815-080fb6c22910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8223eb8-138e-4009-a936-c0b077593234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:12 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[265bc2c0-33c6-44be-8619-f63b413208a2]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG os_brick.utils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating existing volume attachment record: 3e2b7e48-9bad-4233-be65-e5bf104ccf10 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No BDM found with device name sda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] No VIF found with MAC fa:16:3e:d8:75:9c, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:12 user nova-compute[75073]: WARNING nova.compute.manager [req-806769d6-be25-49b5-8b3b-0f5d02b7c092 req-2213fb81-31f6-42be-a44d-60b67826b74d service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state active and task_state rebuilding.
Nov 24 10:23:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance destroyed successfully.
Nov 24 10:23:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance destroyed successfully.
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478155882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf31f42-7b, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=955b025c-efc5-4b8f-adb7-072b888f139b) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:13 user nova-compute[75073]: INFO os_vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b')
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb84f6-7b2f-486f-9579-50027ccecb4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:13 user nova-compute[75073]: No targets found.
Nov 24 10:23:13 user nova-compute[75073]: iSNS:
Nov 24 10:23:13 user nova-compute[75073]: No targets found.
Nov 24 10:23:13 user nova-compute[75073]: STATIC:
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:13 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:13 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:13 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:13 user nova-compute[75073]: No targets found.
Nov 24 10:23:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:13 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:13 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b703ee87-7e7c-49b9-973f-12815342c4d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ec97df-05f9-4204-8d2c-d5ffcb029c4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:13 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2405b0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603'): ({'sdd'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Removing single pathed devices sdd {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[75540bf5-8bfb-4e6f-8f60-f7bcd2ce7e98]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a63a47e-f1e9-44cb-877d-a144e14a7493]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flushing IO for device /dev/sdd {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62869423-490b-49a4-9fb0-d1cc95f87545]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374b640-8a5b-4538-b0ef-ef69b68af120]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9281b883-1953-4929-8e9b-c3156d954898]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b491996-bf1e-451c-a39c-75dc82ce4751]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]
Nov 24 10:23:13 user nova-compute[75073]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d87e6e-1025-4240-b769-b52204a0cb5e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== disconnect_volume: return (389ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deleting instance files /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1_del
Nov 24 10:23:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deletion of /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1_del complete
Nov 24 10:23:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75073) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 24 10:23:13 user nova-compute[75073]: INFO nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] UEFI support detected
Nov 24 10:23:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:14 user nova-compute[75073]: WARNING nova.compute.manager [req-f9e71c9b-8bfb-46bd-81c0-e11d4a6cda86 req-c9168287-1688-4892-8d2d-797267d49af1 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state active and task_state rebuilding.
Nov 24 10:23:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfQgvZEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:17 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'serial': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2064dc83-8441-4f54-bc65-3d63b47f23f1', 'serial'} {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fe9633-c084-4a01-84b1-bee870dcc8bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:17 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[65037804-42a9-4e56-a7fc-58b98e96f428]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c] added
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d37ab-12e0-410d-ba36-e06b01626843]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5e7129-7e54-4db6-8ded-b71d4fcb5953]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfQgvZEN {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfQgvZEN" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[63835d60-7af9-45a2-a381-22d22aa4ac4e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfQgvZEN'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12813a4f-80da-4726-a695-eb73c5a574eb tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.568s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7184e5-f4a4-4347-9e7a-44ac1e6e0c95]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860186f-2f8c-4390-be4a-01b89488781c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb10a1a-c208-4be5-b0bc-05f260c5a396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260]
Nov 24 10:23:17 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4e650-79d7-452f-934d-4da71940624f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a110bc-c09d-4de3-83c3-222f1ef50c00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:17 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8483f81-5948-4b3f-92e2-4e53f7b5c48b]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfQgvZEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:18 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 could not be found.
Nov 24 10:23:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:18 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26332653161393766', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653161393766', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.381s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:18 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:18 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'flavor' on Instance uuid facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33b80d9-224d-4e0c-839a-8d92205974ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:18 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:23:18 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:18 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:23:18 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:18 user nova-compute[75073]:   <serial>969af41e-fe79-43fd-84de-ac56899c860c</serial>
Nov 24 10:23:18 user nova-compute[75073]: </disk>
Nov 24 10:23:18 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[05666329-b32f-447e-862a-b90884faedc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b] added
Nov 24 10:23:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80b1ee-2da1-4e41-ae78-4ca4bbe4a117]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[282129c3-7bda-4953-abc0-230fe8146e00]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVHCTsZq {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MVHCTsZq" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6ea34-90b8-4be8-8938-e6cd8c10034f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MVHCTsZq'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88147db-a9bd-4d78-b24f-f3eef46a52e7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c4e86-6170-4462-aa9c-7d018c1d1c46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[54816a4b-d210-4fea-8861-92d885777c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260]
Nov 24 10:23:19 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e14952-d8ec-4be1-8f25-d8554ab084ed]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c788b-3d9d-4489-bcbb-e31ba2839f10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:19 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:19 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ac8b6-75d5-4cc8-b601-8308223ad2f8]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No VIF found with MAC fa:16:3e:29:9b:30, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c19c1929-5b93-4e03-83a2-e213788107f2 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.039s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxoNZktH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:19 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:19 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:19 user nova-compute[75073]: INFO nova.compute.manager [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Detaching volume f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:20 user nova-compute[75073]: INFO nova.virt.block_device [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Attempting to driver detach volume f088f44b-a133-4a8f-87e5-2be2d116f326 from mountpoint /dev/sdc
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Attempting to detach device sdc from instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:20 user nova-compute[75073]:   <source dev="/dev/sdj"/>
Nov 24 10:23:20 user nova-compute[75073]:   <target dev="sdc" bus="scsi"/>
Nov 24 10:23:20 user nova-compute[75073]:   <serial>f088f44b-a133-4a8f-87e5-2be2d116f326</serial>
Nov 24 10:23:20 user nova-compute[75073]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 24 10:23:20 user nova-compute[75073]: </disk>
Nov 24 10:23:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Successfully detached device sdc from instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 from the persistent domain config.
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:20 user nova-compute[75073]:   <source dev="/dev/sdj"/>
Nov 24 10:23:20 user nova-compute[75073]:   <target dev="sdc" bus="scsi"/>
Nov 24 10:23:20 user nova-compute[75073]:   <serial>f088f44b-a133-4a8f-87e5-2be2d116f326</serial>
Nov 24 10:23:20 user nova-compute[75073]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 24 10:23:20 user nova-compute[75073]: </disk>
Nov 24 10:23:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== connect_volume: return (2830ms) {'type': 'block', 'scsi_wwn': '23065313534363736', 'path': '/dev/sdk'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065313534363736', 'path': '/dev/sdk'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.626s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lazy-loading 'flavor' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d78969-d8a2-4536-8101-6408e0c49309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:20 user nova-compute[75073]: No targets found.
Nov 24 10:23:20 user nova-compute[75073]: iSNS:
Nov 24 10:23:20 user nova-compute[75073]: No targets found.
Nov 24 10:23:20 user nova-compute[75073]: STATIC:
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:20 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:20 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:20 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:20 user nova-compute[75073]: No targets found.
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:20 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:20 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59b3fb-f7c2-41dd-b5a0-6911cb57b742]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d535912b-cf73-46f9-8f2a-1f96de5fb50c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23846d510>, {}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Disconnecting from: [] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.123s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== disconnect_volume: return (1749ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.576s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:20 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:20 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[111120ed-c152-441c-89ca-171a21a8a77d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:20 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e38c82e-2e9a-46e3-9f09-aee2abb39feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e] added
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9425a9-0e46-4d2e-a468-d5c7f5b7527a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[674ebf69-ab89-4b67-a8e6-0605b4c5533a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxoNZktH {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxoNZktH" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb6cd33-aac1-4e0d-9273-4acc0b976bed]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxoNZktH'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b301daf-ed22-4b40-bd1e-620d68c704f6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c99144-e4c4-4f70-8f5a-f790903856b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d2a5d8-758f-42ab-9aec-27ca784157cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260]
Nov 24 10:23:20 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708a67f-6f73-48ee-8f23-828dfe704155]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b397d-759e-449b-9d78-7604d5b4333d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:20 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:20 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd56cf6-f7e4-4be3-8e31-2ae20fddfd9e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxoNZktH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:21 user nova-compute[75073]: INFO nova.compute.manager [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Detaching volume 969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 82837504 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:21 user nova-compute[75073]: INFO nova.virt.block_device [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Attempting to driver detach volume 969af41e-fe79-43fd-84de-ac56899c860c from mountpoint /dev/vdb
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Attempting to detach device vdb from instance facaa348-1d98-45d0-8ea8-77746a7f943f from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:21 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:21 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:23:21 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:21 user nova-compute[75073]:   <serial>969af41e-fe79-43fd-84de-ac56899c860c</serial>
Nov 24 10:23:21 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:21 user nova-compute[75073]: </disk>
Nov 24 10:23:21 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully detached device vdb from instance facaa348-1d98-45d0-8ea8-77746a7f943f from the persistent domain config.
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance facaa348-1d98-45d0-8ea8-77746a7f943f from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:21 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:21 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:23:21 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:21 user nova-compute[75073]:   <serial>969af41e-fe79-43fd-84de-ac56899c860c</serial>
Nov 24 10:23:21 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:21 user nova-compute[75073]: </disk>
Nov 24 10:23:21 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] <== connect_volume: return (2065ms) {'type': 'block', 'scsi_wwn': '23464613765643035', 'path': '/dev/sdl'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464613765643035', 'path': '/dev/sdl'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:22 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:23:22 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:22 user nova-compute[75073]:   <source dev="/dev/sdl"/>
Nov 24 10:23:22 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:22 user nova-compute[75073]:   <serial>e56e1dda-4b07-401a-9cfa-72e9b1908f9e</serial>
Nov 24 10:23:22 user nova-compute[75073]: </disk>
Nov 24 10:23:22 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 234881024 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 346030080 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No BDM found with device name hda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] No VIF found with MAC fa:16:3e:74:6e:7f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 362807296 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3bde7053-c848-43a0-9478-432707a7d0a8 tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.684s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 515899392 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Preparing to wait for external event volume-reimaged-c219be38-d43f-46f2-b035-d18e8225d603 {{(pid=75073) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 638582784 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:24 user nova-compute[75073]: INFO nova.compute.manager [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Detaching volume e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 762314752 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:24 user nova-compute[75073]: INFO nova.virt.block_device [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Attempting to driver detach volume e56e1dda-4b07-401a-9cfa-72e9b1908f9e from mountpoint /dev/vdb
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Attempting to detach device vdb from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:24 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:24 user nova-compute[75073]:   <source dev="/dev/sdl"/>
Nov 24 10:23:24 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:24 user nova-compute[75073]:   <serial>e56e1dda-4b07-401a-9cfa-72e9b1908f9e</serial>
Nov 24 10:23:24 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:23:24 user nova-compute[75073]: </disk>
Nov 24 10:23:24 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully detached device vdb from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the persistent domain config.
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:24 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:24 user nova-compute[75073]:   <source dev="/dev/sdl"/>
Nov 24 10:23:24 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:24 user nova-compute[75073]:   <serial>e56e1dda-4b07-401a-9cfa-72e9b1908f9e</serial>
Nov 24 10:23:24 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:23:24 user nova-compute[75073]: </disk>
Nov 24 10:23:24 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 942669824 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:25 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[88629ea0-ba39-423c-a672-58120ab99129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:25 user nova-compute[75073]: No targets found.
Nov 24 10:23:25 user nova-compute[75073]: iSNS:
Nov 24 10:23:25 user nova-compute[75073]: No targets found.
Nov 24 10:23:25 user nova-compute[75073]: STATIC:
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:25 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:25 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:25 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:25 user nova-compute[75073]: No targets found.
Nov 24 10:23:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:25 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:25 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa61908-442f-4b7c-9ca3-51628c308a85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e76e19-f50e-44aa-8752-eab9f7e636fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:25 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2384727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1'): ({'sdi'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Removing single pathed devices sdi {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaaaf19-e9e6-478e-8e94-3fdf70ed9422]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f72629-e7b7-4588-ac5f-cbd5b5d45e37]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Flushing IO for device /dev/sdi {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af7da71-f25d-4d59-bbba-29df82c243e2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c8d309-9be5-4077-8c98-ef9d01d70d76]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] SCSI volumes sdi have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38fec3a-93d2-447a-ab55-3c3d35db4352]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca547fc-33a9-4a2b-b902-d35ad9999647]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]
Nov 24 10:23:26 user nova-compute[75073]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4006b-e249-4a99-a040-028ff54b6c55]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== disconnect_volume: return (369ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'serial'} {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 24 10:23:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: removing Cinder connection for volume 2064dc83-8441-4f54-bc65-3d63b47f23f1 {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: Updating volume 2064dc83-8441-4f54-bc65-3d63b47f23f1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MVHCTsZq", "auth_password": "nV45NgworPZ82u", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b"}, "status": "reserved", "instance": "fb7cefcf-9df1-4174-b68c-addb1af850a0", "attached_at": "", "detached_at": "", "volume_id": "5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b", "serial": "5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'no_device': None, 'attachment_id': 'f39e7ce9-cfb1-410d-98d4-e91c88492488'} {{(pid=75073) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8e59445c-0fb7-4b70-9d97-fa9d2405e13d tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.292s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.utils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce68cdc-d156-43fe-838d-908270bc6ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[699409f2-ab45-4e19-b3fa-54ef9103b90e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eff039-d101-4141-97c5-59989561de64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1de9e8-10c1-4800-be12-3ddb8f21b336]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:27 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6aaa1-bed4-4e85-b96b-dd11922ceea3]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:27 user nova-compute[75073]: DEBUG os_brick.utils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:28 user nova-compute[75073]: INFO nova.compute.manager [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Swapping volume 5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b for 2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idWkNpRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:31 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14311a8-4b9c-4bf8-8e17-fbb8f29a50d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a96e35-4354-468e-b5c1-ad3b995c1cc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18] added
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8156a-75fa-478e-9995-65c7219a71e0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d8573-025b-46e2-aa95-0ae3f6bbd6c0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idWkNpRQ {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idWkNpRQ" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b514c4bf-c118-484b-8335-2b92f524645a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idWkNpRQ'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa6f67-a069-440b-ac4f-8ec38b18b0b4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd3f537-6cc9-4268-bd5d-89291db888bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582ebea-ff9d-4db5-91c7-fb3aa8dc6d9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260]
Nov 24 10:23:31 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb1b64-a9dc-4b25-aa7f-f174eb7b86b7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d84ed8b-88fa-4816-86c6-9c324664f9f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:31 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] HCTL ('40', '-', '-', 0) found on session 16 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[98428ff3-e7b7-4a2c-8385-a56e085b5d8d]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Searching for a device in session 16 and hctl ['40', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating instance_info_cache with network_info: [{"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-facaa348-1d98-45d0-8ea8-77746a7f943f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Searching for a device in session 16 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idWkNpRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26465353435636163', 'path': '/dev/sdi'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465353435636163', 'path': '/dev/sdi'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lazy-loading 'flavor' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] attach device xml: <disk type="block" device="disk">
Nov 24 10:23:32 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:32 user nova-compute[75073]:   <source dev="/dev/sdi"/>
Nov 24 10:23:32 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:32 user nova-compute[75073]:   <serial>cd438934-60aa-408f-9357-55a3fddddb18</serial>
Nov 24 10:23:32 user nova-compute[75073]: </disk>
Nov 24 10:23:32 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] No VIF found with MAC fa:16:3e:cb:1e:98, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-changed-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing instance network info cache due to event network-changed-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] Acquiring lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] Acquired lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.network.neutron [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Refreshing network info cache for port ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c85bc50f-ae3f-462d-a88f-fdff87e5df4d tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.181s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.network.neutron [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updated VIF entry in instance network info cache for port ed85e937-5c71-4e7a-8235-4ddd4ec27ceb. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.network.neutron [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-85d51893-ecdd-4dda-bcc6-b57b7fff8994 req-62530dc8-9de4-4a9c-8708-6c37367d8226 service nova] Releasing lock "refresh_cache-7543d0e1-4197-4a0b-996d-0af2c4999288" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] volume_snapshot_create: create_info: {'snapshot_id': 'dc17d732-3691-458e-96e6-76d0716cbf57', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75073) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] snap xml: <domainsnapshot>
Nov 24 10:23:33 user nova-compute[75073]:   <disks>
Nov 24 10:23:33 user nova-compute[75073]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 24 10:23:33 user nova-compute[75073]:       <source file="/dev/new_file"/>
Nov 24 10:23:33 user nova-compute[75073]:     </disk>
Nov 24 10:23:33 user nova-compute[75073]:     <disk name="vda" snapshot="no"/>
Nov 24 10:23:33 user nova-compute[75073]:   </disks>
Nov 24 10:23:33 user nova-compute[75073]: </domainsnapshot>
Nov 24 10:23:33 user nova-compute[75073]:  {{(pid=75073) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] Lazy-loading 'system_metadata' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 10:23:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fc16f5a1-6f87-458d-bb99-c2f87eaf5c34 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] volume_snapshot_delete: delete_info: {'volume_id': 'cd438934-60aa-408f-9357-55a3fddddb18'} {{(pid=75073) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [None req-fc16f5a1-6f87-458d-bb99-c2f87eaf5c34 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     if delete_info['type'] != 'qcow2':
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] KeyError: 'type'
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     rv = execute(f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     six.reraise(c, e, tb)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     raise value
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     rv = meth(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     self._volume_snapshot_create(context, instance, guest,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     rv = execute(f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     six.reraise(c, e, tb)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     raise value
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     rv = meth(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [None req-fc16f5a1-6f87-458d-bb99-c2f87eaf5c34 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ff35d916-3676-4fc1-abed-dc48decb5562)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server [None req-fc16f5a1-6f87-458d-bb99-c2f87eaf5c34 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] Exception during message handling: KeyError: 'type'
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot dc17d732-3691-458e-96e6-76d0716cbf57 could not be found.
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise value
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot dc17d732-3691-458e-96e6-76d0716cbf57 could not be found. (HTTP 404) (Request-ID: req-7fa7f7cf-45b5-4e5d-9127-503f0b1b31b4)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot dc17d732-3691-458e-96e6-76d0716cbf57 could not be found.
Nov 24 10:23:33 user nova-compute[75073]: ERROR nova.virt.libvirt.driver 
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server [None req-65a93d1c-313e-4203-90f2-8c74fd641920 tempest-VolumesAssistedSnapshotsTest-350339370 tempest-VolumesAssistedSnapshotsTest-350339370-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise value
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 10:23:33 user nova-compute[75073]: ERROR oslo_messaging.rpc.server 
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:34 user nova-compute[75073]: INFO nova.compute.manager [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Detaching volume cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:34 user nova-compute[75073]: INFO nova.virt.block_device [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Attempting to driver detach volume cd438934-60aa-408f-9357-55a3fddddb18 from mountpoint /dev/vdb
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Attempting to detach device vdb from instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:34 user nova-compute[75073]:   <source dev="/dev/sdi"/>
Nov 24 10:23:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:34 user nova-compute[75073]:   <serial>cd438934-60aa-408f-9357-55a3fddddb18</serial>
Nov 24 10:23:34 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:34 user nova-compute[75073]: </disk>
Nov 24 10:23:34 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Successfully detached device vdb from instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 from the persistent domain config.
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:34 user nova-compute[75073]:   <source dev="/dev/sdi"/>
Nov 24 10:23:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:34 user nova-compute[75073]:   <serial>cd438934-60aa-408f-9357-55a3fddddb18</serial>
Nov 24 10:23:34 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:34 user nova-compute[75073]: </disk>
Nov 24 10:23:34 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:35 user nova-compute[75073]: INFO nova.compute.manager [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Terminating instance
Nov 24 10:23:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-6377662a-e044-4538-baac-cb15535cf621 req-98f9c4da-7410-435c-98d9-b59435abb57c service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-68b8262d-ca2b-4701-bb99-379737abc844 req-97930e30-e25b-4636-a630-8c3c8fe3ccc8 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-8397db81-f31d-490e-b032-84aeb250301a for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-635745cd-bbf3-465e-a129-0734d42134d4 req-0340070f-a272-4213-886b-9d27da2b090b service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:23:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Instance destroyed successfully.
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.objects.instance [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lazy-loading 'resources' on Instance uuid 7543d0e1-4197-4a0b-996d-0af2c4999288 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped85e937-5c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4368b8f2-9354-4c18-a778-2f9430abbc87) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b4:9b,bridge_name='br-int',has_traffic_filtering=True,id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb,network=Network(54a9c716-6296-4472-9d94-0076c89cbcd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85e937-5c')
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8397db81-f3, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2f9a824-f637-4aa4-88af-1c7a47824886) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-c30151c6-9af0-4401-a4f9-00d7e7563e3a for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-b408c1cb-d580-43d7-ac6a-db948fb804db for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-843a1430-acd9-464f-8c19-e3b1a3a404ae req-f0aba14f-65db-4ea6-b7ed-c7b2407d33e5 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-b408c1cb-d580-43d7-ac6a-db948fb804db for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=8397db81-f31d-490e-b032-84aeb250301a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8397db81-f3')
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc30151c6-9a, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-8397db81-f31d-490e-b032-84aeb250301a for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-eab74823-ea8f-4e4d-922b-3949117b0a29 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-eab74823-ea8f-4e4d-922b-3949117b0a29 for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-unplugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-unplugged-7e01face-a349-4681-a9e8-fabeef9fa35d for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-a5233a55-ed69-4140-9d05-51d31aa589ee req-347cd469-0b98-4163-8152-938b33617937 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-7e01face-a349-4681-a9e8-fabeef9fa35d for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02266f81-5157-446d-9f51-634b077f9918) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0b:2a,bridge_name='br-int',has_traffic_filtering=True,id=c30151c6-9af0-4401-a4f9-00d7e7563e3a,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc30151c6-9a')
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "address": "fa:16:3e:6c:a7:cc", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd2a6c0-c5", "ovs_interfaceid": "bfd2a6c0-c57a-49c3-90bc-f81114e0efd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfd2a6c0-c5, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7a001ea-2c2f-43b9-a722-ed92f9b09b04) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a7:cc,bridge_name='br-int',has_traffic_filtering=True,id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd2a6c0-c5')
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeab74823-ea, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc4556e7-0ae2-471f-902e-f953130c4e54) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] Acquiring lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] No waiting events found dispatching network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:38 user nova-compute[75073]: WARNING nova.compute.manager [req-097373db-b84d-4a9e-9b46-db14e4ac05bc req-8a99ea7e-1108-47ba-b8cb-c79713ef9e95 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received unexpected event network-vif-plugged-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 for instance with vm_state active and task_state deleting.
Nov 24 10:23:38 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:80:64,bridge_name='br-int',has_traffic_filtering=True,id=eab74823-ea8f-4e4d-922b-3949117b0a29,network=Network(0644ac94-42d8-4081-8a5c-3f8e970f2b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab74823-ea')
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e01face-a3, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aad8bd10-7398-45fd-a96f-6b0d8ff5b665) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:39 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:33:c9,bridge_name='br-int',has_traffic_filtering=True,id=7e01face-a349-4681-a9e8-fabeef9fa35d,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e01face-a3')
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-30671254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-30671254',id=10,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjowfFB0PwVkUvtWkpn0+30KEPQjZxoVVj/4Kr2Ig1N2qjmh5fUeBxx3rBJoJ8NR0kaDpAh9yNdudO8bZz5GBncTXWSTTU1g6DS8ZadyfeGeBBblGZljTe5Bt1CfhWBAQ==',key_name='tempest-keypair-79965024',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3ac30811c254692a7412ca51bea9436',ramdisk_id='',reservation_id='r-e4y7pdhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-655101029',owner_user_name='tempest-TaggedBootDevicesTest-655101029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a60289fb34b4e3a88ac5537032ef8ab',uuid=7543d0e1-4197-4a0b-996d-0af2c4999288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converting VIF {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb408c1cb-d5, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e96c43aa-cdb7-4811-afaf-02fe5bca18c0) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:23:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7393MB free_disk=25.614093780517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:39 user nova-compute[75073]: INFO os_vif [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=b408c1cb-d580-43d7-ac6a-db948fb804db,network=Network(d3e44467-9479-4247-b0d2-bcdba3dd2562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb408c1cb-d5')
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJlXGAOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:39 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381f8f9-c599-4883-861a-754889f56567]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]: iSNS:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]: STATIC:
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:39 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:39 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cc13e2-f800-46bd-95be-10dea076641f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff354488-b2eb-4fff-8e8d-d2219a4df2b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383e0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fb7cefcf-9df1-4174-b68c-addb1af850a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8afebb27-fa78-48be-8750-a1d8141e10c9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 7543d0e1-4197-4a0b-996d-0af2c4999288 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e52c0-58a6-4713-92d1-882e48f13ed3]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68db58e-f8ea-4a70-9f9e-f31b96f4141d]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca27c7-4764-40e6-8691-0d8206f926e6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a415fd6a-6cce-4c4a-90a7-fdf69f2ab836]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d850eade-0ec7-46b5-8756-439439183c75]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4455f19-7422-4c05-9124-a7f51cab07cd]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260]
Nov 24 10:23:39 user nova-compute[75073]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13f77d9b-cddf-4ee9-a50e-9eed6b91d071 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b66a2c-6d32-4955-b8ec-6b3e28cc3886]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== disconnect_volume: return (448ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrPYxmJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:39 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff299cd-ad14-4266-970f-b4df7cc471b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]: iSNS:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]: STATIC:
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:39 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:39 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:39 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:39 user nova-compute[75073]: No targets found.
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:39 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:39 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e59e6-f020-430a-9d99-f2753209af96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ddd7d-bc1d-4047-b2a3-76da4cd5933a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:39 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383f3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[192297d1-58a1-486c-8f80-a6646c8b4f31]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd4637-465b-44b1-88de-ffc87d89b8dc]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fb8f5c-b5b0-4f0f-8be7-5c3497943122]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa03a6a-d4b8-464f-8034-26b7b2d977c2]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b00309-370b-457d-a53b-b1b6675c2463]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1f7f8-96f1-4f83-94b1-54d3f1a1c1ed]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260]
Nov 24 10:23:40 user nova-compute[75073]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db902f4b-1a76-4f80-8452-686ef1ec49c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd515f-79ac-4236-b47c-a6e7bee8b201]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== disconnect_volume: return (423ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPzSdxNR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:40 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0edf50-63ec-45e2-882b-90a0bc5ddb85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]: iSNS:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]: STATIC:
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:40 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:40 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b4051-4108-463f-a3e7-e89a609fb33c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b62c14-83ae-4016-95d8-efa3d9b2250b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2384736d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a'): ({'sde'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Removing single pathed devices sde {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a98a84-ce98-4b25-9312-1da6dc412f3f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[37734bbe-5aa1-4966-8cb8-16ec59640115]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Flushing IO for device /dev/sde {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6918c91-a6ec-4cda-b04d-c2c16eb287dd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34909b3-a060-403b-9c5d-32f8abd20e80]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8249b706-ec3c-451b-a658-e6c633cd581c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924b945-1e14-4f9a-8a5a-86b24fcd4ca1]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260]
Nov 24 10:23:40 user nova-compute[75073]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea7df4b-8a5c-4eda-92d2-431e795cde5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514ab44-e118-4660-8d9d-066243bac965]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] <== disconnect_volume: return (404ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Deleting instance files /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288_del
Nov 24 10:23:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Deletion of /opt/stack/data/nova/instances/7543d0e1-4197-4a0b-996d-0af2c4999288_del complete
Nov 24 10:23:40 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 is timed out.
Nov 24 10:23:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Successfully detached device sdc from instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 from the live domain config.
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKHiastR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:40 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d50e74c-375a-45e1-8444-560324a2e2f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]: iSNS:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]: STATIC:
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:40 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:40 user nova-compute[75073]: No targets found.
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:40 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:40 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26982c-569a-4558-8da9-e934f8806fa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53cb320-9908-4cbd-91c4-431d7a3d5694]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:40 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb24026bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326'): ({'sdj'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Removing single pathed devices sdj {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: INFO nova.compute.manager [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Took 4.97 seconds to destroy the instance on the hypervisor.
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.058s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cb6ef2-e0bb-45b7-a409-fc87448aac40]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3b82ee-134f-4fbd-8f87-974e146412da]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Flushing IO for device /dev/sdj {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5335251-7cd6-417d-a046-66c41e1f5414]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2c2b63-f256-4a85-bd52-899a7074cbaa]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] SCSI volumes sdj have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bba89a-85e7-4bc6-ba23-fb34b78538e2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341f47a-9884-48b9-978c-289dc72bd4e0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260]
Nov 24 10:23:41 user nova-compute[75073]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f088f44b-a133-4a8f-87e5-2be2d116f326 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a7404-0b43-43dd-a8c9-aa1e90455500]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] <== disconnect_volume: return (397ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2064dc83-8441-4f54-bc65-3d63b47f23f1', 'serial': '2064dc83-8441-4f54-bc65-3d63b47f23f1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b'}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'serial'} {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:41 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:41 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:41 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c8208-f0da-452b-96cd-be9de64d85ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:41 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd019cd6-fbd3-426b-aa5c-f1e530d706de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1] added
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa6c97-1fc8-458e-8eee-d4b1a198bc36]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af7742-ba91-4045-aa80-ebed3c727111]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJUgNYXI {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJUgNYXI" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c949a08-d9d6-494b-9e6b-1fdebb5cb4c1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJUgNYXI'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce67968f-679e-424b-9d60-98b41052ee22]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df70fee-40a1-44d8-9dbf-7f4b1027637a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.267s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51ba14a-7745-464c-8d4f-4d62b56be74a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]
Nov 24 10:23:41 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3973ee6b-5211-41fb-917d-e558c98d6f93]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a088d-f2eb-4f42-a3b4-b3ccae47422b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:41 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd4570-6e5f-4195-b7e5-c3a5dfabec75]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:23:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:23:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance facaa348-1d98-45d0-8ea8-77746a7f943f is timed out.
Nov 24 10:23:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully detached device vdb from instance facaa348-1d98-45d0-8ea8-77746a7f943f from the live domain config.
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfQgvZEN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:42 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-97e292ce-a4cb-4de7-ad0b-37443e7eba06 req-b8ffbec4-ddc2-4453-8bf7-2fc83673e5b1 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-deleted-bfd2a6c0-c57a-49c3-90bc-f81114e0efd7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:42 user nova-compute[75073]: INFO nova.compute.manager [req-97e292ce-a4cb-4de7-ad0b-37443e7eba06 req-b8ffbec4-ddc2-4453-8bf7-2fc83673e5b1 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Neutron deleted interface bfd2a6c0-c57a-49c3-90bc-f81114e0efd7; detaching it from the instance and deleting it from the info cache
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.network.neutron [req-97e292ce-a4cb-4de7-ad0b-37443e7eba06 req-b8ffbec4-ddc2-4453-8bf7-2fc83673e5b1 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eab74823-ea8f-4e4d-922b-3949117b0a29", "address": "fa:16:3e:11:80:64", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab74823-ea", "ovs_interfaceid": "eab74823-ea8f-4e4d-922b-3949117b0a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-97e292ce-a4cb-4de7-ad0b-37443e7eba06 req-b8ffbec4-ddc2-4453-8bf7-2fc83673e5b1 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Detach interface failed, port_id=bfd2a6c0-c57a-49c3-90bc-f81114e0efd7, reason: Instance 7543d0e1-4197-4a0b-996d-0af2c4999288 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== connect_volume: return (1552ms) {'type': 'block', 'scsi_wwn': '23334663561626131', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334663561626131', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.576s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lazy-loading 'flavor' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a3b38-25a7-47b5-bfd7-938b0de8c960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:42 user nova-compute[75073]: No targets found.
Nov 24 10:23:42 user nova-compute[75073]: iSNS:
Nov 24 10:23:42 user nova-compute[75073]: No targets found.
Nov 24 10:23:42 user nova-compute[75073]: STATIC:
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:42 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:42 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:42 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:42 user nova-compute[75073]: No targets found.
Nov 24 10:23:42 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:42 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:42 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308d5fe-cbbb-4e95-a861-d18c1f629037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf84908-555f-4919-a5ce-216c1cbb0c9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:42 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:42 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383f3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c'): ({'sdd'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Removing single pathed devices sdd {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf0767-455f-44e3-a84b-df153258d5ec]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0058505-01af-411c-b616-03c6b53dc612]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Flushing IO for device /dev/sdd {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1252cc-c771-45f0-8c0e-2de3d10d868a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65bbde3-4647-40b0-a1ff-cb68238b1164]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e957ef-fcaf-462f-b818-0cd8a5d93ffa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38443979-a855-416e-a8fa-2ea4d240ace7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260]
Nov 24 10:23:43 user nova-compute[75073]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969af41e-fe79-43fd-84de-ac56899c860c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ee7c6-4d2f-493a-8a58-b0d65ade059c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] <== disconnect_volume: return (974ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-deleted-eab74823-ea8f-4e4d-922b-3949117b0a29 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:44 user nova-compute[75073]: INFO nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Neutron deleted interface eab74823-ea8f-4e4d-922b-3949117b0a29; detaching it from the instance and deleting it from the info cache
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "address": "fa:16:3e:01:b4:9b", "network": {"id": "54a9c716-6296-4472-9d94-0076c89cbcd1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-320249456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped85e937-5c", "ovs_interfaceid": "ed85e937-5c71-4e7a-8235-4ddd4ec27ceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Detach interface failed, port_id=eab74823-ea8f-4e4d-922b-3949117b0a29, reason: Instance 7543d0e1-4197-4a0b-996d-0af2c4999288 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-deleted-ed85e937-5c71-4e7a-8235-4ddd4ec27ceb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:44 user nova-compute[75073]: INFO nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Neutron deleted interface ed85e937-5c71-4e7a-8235-4ddd4ec27ceb; detaching it from the instance and deleting it from the info cache
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [{"id": "8397db81-f31d-490e-b032-84aeb250301a", "address": "fa:16:3e:72:3a:18", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8397db81-f3", "ovs_interfaceid": "8397db81-f31d-490e-b032-84aeb250301a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "address": "fa:16:3e:d3:0b:2a", "network": {"id": "0644ac94-42d8-4081-8a5c-3f8e970f2b85", "bridge": "br-int", "label": "tempest-device-tagging-net1-1735135089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc30151c6-9a", "ovs_interfaceid": "c30151c6-9af0-4401-a4f9-00d7e7563e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e01face-a349-4681-a9e8-fabeef9fa35d", "address": "fa:16:3e:bf:33:c9", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e01face-a3", "ovs_interfaceid": "7e01face-a349-4681-a9e8-fabeef9fa35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b408c1cb-d580-43d7-ac6a-db948fb804db", "address": "fa:16:3e:8c:a4:96", "network": {"id": "d3e44467-9479-4247-b0d2-bcdba3dd2562", "bridge": "br-int", "label": "tempest-device-tagging-net2-990180391", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e3ac30811c254692a7412ca51bea9436", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb408c1cb-d5", "ovs_interfaceid": "b408c1cb-d580-43d7-ac6a-db948fb804db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9332674-3b45-4485-a5c0-5dd3ce580a06 req-e9719a91-d50c-49ab-be88-006e17b58ae0 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Detach interface failed, port_id=ed85e937-5c71-4e7a-8235-4ddd4ec27ceb, reason: Instance 7543d0e1-4197-4a0b-996d-0af2c4999288 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:45 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Took 4.36 seconds to deallocate network for instance.
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 is timed out.
Nov 24 10:23:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully detached device vdb from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the live domain config.
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxoNZktH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:45 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce6441-9a49-4f53-9c5a-b01d2c6195f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:45 user nova-compute[75073]: No targets found.
Nov 24 10:23:45 user nova-compute[75073]: iSNS:
Nov 24 10:23:45 user nova-compute[75073]: No targets found.
Nov 24 10:23:45 user nova-compute[75073]: STATIC:
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:45 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:45 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:45 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:45 user nova-compute[75073]: No targets found.
Nov 24 10:23:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:45 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:45 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf3087-a110-427d-a63c-5db59be27b17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd0488-118a-4599-b762-a48ac7ddeb03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:45 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23846d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e'): ({'sdl'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Removing single pathed devices sdl {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1f6ca-7cd1-4ae7-bb0a-5f0a1f4f89e6]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lazy-loading 'flavor' on Instance uuid fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[763db07e-c1cb-4133-bc00-2a97db68817f]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Flushing IO for device /dev/sdl {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12c50c-8227-4e86-8e0b-23a90d87c559]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5eca48-9a45-42cb-8c0b-abd2ab7b414f tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.825s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.049s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f6680-ca38-4d5f-af3e-ac111654207e]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] SCSI volumes sdl have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f75559-6b33-4628-a436-033a1569a331]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e5ecd-3097-4b71-8a8d-b6f09922e03f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260]
Nov 24 10:23:45 user nova-compute[75073]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e56e1dda-4b07-401a-9cfa-72e9b1908f9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322d18d-583d-40eb-b797-bf9056ae390d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] <== disconnect_volume: return (400ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 38797312 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'flavor' on Instance uuid facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 50331648 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fd73a05c-bd03-47f1-8318-71841ec9c63e tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.960s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:46 user nova-compute[75073]: INFO nova.compute.manager [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Terminating instance
Nov 24 10:23:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-b6e28f6b-4ff0-4cf2-8706-566cc5ac624a req-7876fcdc-1978-4eee-8d3a-346fecb936e9 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-deleted-7e01face-a349-4681-a9e8-fabeef9fa35d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-b6e28f6b-4ff0-4cf2-8706-566cc5ac624a req-7876fcdc-1978-4eee-8d3a-346fecb936e9 service nova] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Received event network-vif-deleted-b408c1cb-d580-43d7-ac6a-db948fb804db {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-unplugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] No waiting events found dispatching network-vif-unplugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bc7586f-4557-4100-aa9a-d437ae7b66c9 req-d3774b31-5f13-4943-adcc-bd3b52fced55 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-unplugged-2960f7ca-09c6-490e-95b0-5de751a66fee for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 197132288 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:47 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Instance destroyed successfully.
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lazy-loading 'resources' on Instance uuid fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1534884870',display_name='tempest-AttachSCSIVolumeTestJSON-server-1534884870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1534884870',id=5,image_ref='3c495efe-92bd-4f04-b255-434e5752edad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcZ/NINDUyMux9tFn26e5vXbHZ6dBsl0I82iduplNm67TD3KDvuRXNNtxSDCdBkrz3A3jmSwqDIeNmyJsDpUvkLrXh90rtXV/bRNfRQSs3nVWzO1sF3NTrQsuVfNqtwYQ==',key_name='tempest-keypair-20128217',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3de0eafd4394b549aca7bfeecc5e673',ramdisk_id='',reservation_id='r-jfuh6394',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3c495efe-92bd-4f04-b255-434e5752edad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-253116183',owner_user_name='tempest-AttachSCSIVolumeTestJSON-253116183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38c3bb8e82e84c83ac6632cdf8500ecd',uuid=fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converting VIF {"id": "2960f7ca-09c6-490e-95b0-5de751a66fee", "address": "fa:16:3e:d8:75:9c", "network": {"id": "1b3e40a1-5ba7-4552-958d-389d080fae6c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-764543087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3de0eafd4394b549aca7bfeecc5e673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2960f7ca-09", "ovs_interfaceid": "2960f7ca-09c6-490e-95b0-5de751a66fee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG os_vif [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2960f7ca-09, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=096970d3-cca4-4fef-a416-229db338861a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:47 user nova-compute[75073]: INFO os_vif [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:75:9c,bridge_name='br-int',has_traffic_filtering=True,id=2960f7ca-09c6-490e-95b0-5de751a66fee,network=Network(1b3e40a1-5ba7-4552-958d-389d080fae6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2960f7ca-09')
Nov 24 10:23:47 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Deleting instance files /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9_del
Nov 24 10:23:47 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Deletion of /opt/stack/data/nova/instances/fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9_del complete
Nov 24 10:23:47 user nova-compute[75073]: INFO nova.compute.manager [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 24 10:23:47 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:23:47 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:23:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 342884352 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:48 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:23:48 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Took 1.01 seconds to deallocate network for instance.
Nov 24 10:23:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-d39d521c-f81f-42ed-8765-e53ef3984f55 req-75de0c3d-5133-4711-b747-30f5a91833dc service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-deleted-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 507510784 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:23:49 user nova-compute[75073]: INFO nova.compute.manager [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] [instance: 7543d0e1-4197-4a0b-996d-0af2c4999288] Took 4.13 seconds to detach 3 volumes for instance.
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] Acquiring lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] No waiting events found dispatching network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:49 user nova-compute[75073]: WARNING nova.compute.manager [req-eb6fb6af-a09b-464a-826c-a0cc57c0a992 req-f56892cd-58b3-4a38-a063-2c523df26580 service nova] [instance: fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9] Received unexpected event network-vif-plugged-2960f7ca-09c6-490e-95b0-5de751a66fee for instance with vm_state deleted and task_state None.
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:49 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Deleted allocations for instance fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3b25f422-2f26-4f56-b514-b96bc9468ef9 tempest-AttachSCSIVolumeTestJSON-253116183 tempest-AttachSCSIVolumeTestJSON-253116183-project-member] Lock "fe6bc0f0-2385-4ec8-82f7-6a31fa662ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:23:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:49 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Deleted allocations for instance 7543d0e1-4197-4a0b-996d-0af2c4999288
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-b4de-4080-ac67-2063c7439463 tempest-TaggedBootDevicesTest-655101029 tempest-TaggedBootDevicesTest-655101029-project-member] Lock "7543d0e1-4197-4a0b-996d-0af2c4999288" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.275s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-07ae6e14-4653-4d42-9df8-a99a8054ff13 req-53663833-3d6f-4109-b4e7-f9c4afd11ae5 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event volume-reimaged-c219be38-d43f-46f2-b035-d18e8225d603 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07ae6e14-4653-4d42-9df8-a99a8054ff13 req-53663833-3d6f-4109-b4e7-f9c4afd11ae5 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07ae6e14-4653-4d42-9df8-a99a8054ff13 req-53663833-3d6f-4109-b4e7-f9c4afd11ae5 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07ae6e14-4653-4d42-9df8-a99a8054ff13 req-53663833-3d6f-4109-b4e7-f9c4afd11ae5 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-07ae6e14-4653-4d42-9df8-a99a8054ff13 req-53663833-3d6f-4109-b4e7-f9c4afd11ae5 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Processing event volume-reimaged-c219be38-d43f-46f2-b035-d18e8225d603 {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:23:50 user nova-compute[75073]: INFO nova.virt.block_device [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Booting with volume c219be38-d43f-46f2-b035-d18e8225d603 at /dev/vda
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.utils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4f8bc-9fbd-41c2-af36-9bba63ae359f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5913aef0-dc80-4b12-b2c2-d68b089eb1ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a2c6a-55de-4a9c-8f43-92567b3ab0da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[504eb85b-d00b-41cd-b807-9a8439b01502]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:23:50 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f095d5-9107-4816-a6a6-8bbb78c58626]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG os_brick.utils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating existing volume attachment record: 2f1809ad-b381-4c45-abf6-7b76bbd12a07 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64abe6b-c897-417b-a782-d7a09e48677d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.080s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 938475520 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-14dead6a-e61b-4e0b-bf98-8e724992bbb7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-14dead6a-e61b-4e0b-bf98-8e724992bbb7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Attempting to detach device tap14dead6a-e6 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] detach device xml: <interface type="ethernet">
Nov 24 10:23:51 user nova-compute[75073]:   <mac address="fa:16:3e:bf:22:38"/>
Nov 24 10:23:51 user nova-compute[75073]:   <model type="virtio"/>
Nov 24 10:23:51 user nova-compute[75073]:   <mtu size="1442"/>
Nov 24 10:23:51 user nova-compute[75073]:   <target dev="tap14dead6a-e6"/>
Nov 24 10:23:51 user nova-compute[75073]: </interface>
Nov 24 10:23:51 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 10:23:51 user nova-compute[75073]:   <name>instance-00000006</name>
Nov 24 10:23:51 user nova-compute[75073]:   <uuid>b745dbf9-0dc2-4d1a-b709-d48422e9a537</uuid>
Nov 24 10:23:51 user nova-compute[75073]:   <metadata>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:23:51 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:23:08</nova:creationTime>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:23:51 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:23:51 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:owner>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:23:51 user nova-compute[75073]:   </nova:owner>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:23:51 user nova-compute[75073]:   <nova:ports>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:23:51 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:23:51 user nova-compute[75073]:     </nova:port>
Nov 24 10:23:51 user nova-compute[75073]:     <nova:port uuid="14dead6a-e61b-4e0b-bf98-8e724992bbb7">
Nov 24 10:23:51 user nova-compute[75073]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Nov 24 10:23:51 user nova-compute[75073]:     </nova:port>
Nov 24 10:23:51 user nova-compute[75073]:   </nova:ports>
Nov 24 10:23:51 user nova-compute[75073]: </nova:instance>
Nov 24 10:23:51 user nova-compute[75073]:   </metadata>
Nov 24 10:23:51 user nova-compute[75073]:   <memory unit='KiB'>524288</memory>
Nov 24 10:23:51 user nova-compute[75073]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 10:23:51 user nova-compute[75073]:   <vcpu placement='static'>1</vcpu>
Nov 24 10:23:51 user nova-compute[75073]:   <resource>
Nov 24 10:23:51 user nova-compute[75073]:     <partition>/machine</partition>
Nov 24 10:23:51 user nova-compute[75073]:   </resource>
Nov 24 10:23:51 user nova-compute[75073]:   <sysinfo type='smbios'>
Nov 24 10:23:51 user nova-compute[75073]:     <system>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='version'>0.0.0</entry>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='serial'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='uuid'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:23:51 user nova-compute[75073]:       <entry name='family'>Virtual Machine</entry>
Nov 24 10:23:51 user nova-compute[75073]:     </system>
Nov 24 10:23:51 user nova-compute[75073]:   </sysinfo>
Nov 24 10:23:51 user nova-compute[75073]:   <os>
Nov 24 10:23:51 user nova-compute[75073]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 10:23:51 user nova-compute[75073]:     <boot dev='hd'/>
Nov 24 10:23:51 user nova-compute[75073]:     <smbios mode='sysinfo'/>
Nov 24 10:23:51 user nova-compute[75073]:   </os>
Nov 24 10:23:51 user nova-compute[75073]:   <features>
Nov 24 10:23:51 user nova-compute[75073]:     <acpi/>
Nov 24 10:23:51 user nova-compute[75073]:     <apic/>
Nov 24 10:23:51 user nova-compute[75073]:     <vmcoreinfo state='on'/>
Nov 24 10:23:51 user nova-compute[75073]:   </features>
Nov 24 10:23:51 user nova-compute[75073]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 10:23:51 user nova-compute[75073]:     <model fallback='forbid'>Nehalem</model>
Nov 24 10:23:51 user nova-compute[75073]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 10:23:51 user nova-compute[75073]:     <feature policy='require' name='vme'/>
Nov 24 10:23:51 user nova-compute[75073]:     <feature policy='require' name='x2apic'/>
Nov 24 10:23:51 user nova-compute[75073]:     <feature policy='require' name='hypervisor'/>
Nov 24 10:23:51 user nova-compute[75073]:   </cpu>
Nov 24 10:23:51 user nova-compute[75073]:   <clock offset='utc'>
Nov 24 10:23:51 user nova-compute[75073]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 10:23:51 user nova-compute[75073]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 10:23:51 user nova-compute[75073]:     <timer name='hpet' present='no'/>
Nov 24 10:23:51 user nova-compute[75073]:   </clock>
Nov 24 10:23:51 user nova-compute[75073]:   <on_poweroff>destroy</on_poweroff>
Nov 24 10:23:51 user nova-compute[75073]:   <on_reboot>restart</on_reboot>
Nov 24 10:23:51 user nova-compute[75073]:   <on_crash>destroy</on_crash>
Nov 24 10:23:51 user nova-compute[75073]:   <devices>
Nov 24 10:23:51 user nova-compute[75073]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 10:23:51 user nova-compute[75073]:     <disk type='file' device='disk'>
Nov 24 10:23:51 user nova-compute[75073]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 10:23:51 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk' index='2'/>
Nov 24 10:23:51 user nova-compute[75073]:       <backingStore type='file' index='3'>
Nov 24 10:23:51 user nova-compute[75073]:         <format type='raw'/>
Nov 24 10:23:51 user nova-compute[75073]:         <source file='/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b'/>
Nov 24 10:23:51 user nova-compute[75073]:         <backingStore/>
Nov 24 10:23:51 user nova-compute[75073]:       </backingStore>
Nov 24 10:23:51 user nova-compute[75073]:       <target dev='vda' bus='virtio'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='virtio-disk0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </disk>
Nov 24 10:23:51 user nova-compute[75073]:     <disk type='file' device='cdrom'>
Nov 24 10:23:51 user nova-compute[75073]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 10:23:51 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config' index='1'/>
Nov 24 10:23:51 user nova-compute[75073]:       <backingStore/>
Nov 24 10:23:51 user nova-compute[75073]:       <target dev='hda' bus='ide'/>
Nov 24 10:23:51 user nova-compute[75073]:       <readonly/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='ide0-0-0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </disk>
Nov 24 10:23:51 user nova-compute[75073]:     <controller type='usb' index='0' model='none'>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='usb'/>
Nov 24 10:23:51 user nova-compute[75073]:     </controller>
Nov 24 10:23:51 user nova-compute[75073]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='pci.0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </controller>
Nov 24 10:23:51 user nova-compute[75073]:     <controller type='ide' index='0'>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='ide'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 10:23:51 user nova-compute[75073]:     </controller>
Nov 24 10:23:51 user nova-compute[75073]:     <interface type='ethernet'>
Nov 24 10:23:51 user nova-compute[75073]:       <mac address='fa:16:3e:74:6e:7f'/>
Nov 24 10:23:51 user nova-compute[75073]:       <target dev='tapec1d3f24-31'/>
Nov 24 10:23:51 user nova-compute[75073]:       <model type='virtio'/>
Nov 24 10:23:51 user nova-compute[75073]:       <mtu size='1442'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='net0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </interface>
Nov 24 10:23:51 user nova-compute[75073]:     <interface type='ethernet'>
Nov 24 10:23:51 user nova-compute[75073]:       <mac address='fa:16:3e:bf:22:38'/>
Nov 24 10:23:51 user nova-compute[75073]:       <target dev='tap14dead6a-e6'/>
Nov 24 10:23:51 user nova-compute[75073]:       <model type='virtio'/>
Nov 24 10:23:51 user nova-compute[75073]:       <mtu size='1442'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='net1'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </interface>
Nov 24 10:23:51 user nova-compute[75073]:     <serial type='pty'>
Nov 24 10:23:51 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:23:51 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:23:51 user nova-compute[75073]:       <target type='isa-serial' port='0'>
Nov 24 10:23:51 user nova-compute[75073]:         <model name='isa-serial'/>
Nov 24 10:23:51 user nova-compute[75073]:       </target>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </serial>
Nov 24 10:23:51 user nova-compute[75073]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 10:23:51 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:23:51 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:23:51 user nova-compute[75073]:       <target type='serial' port='0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </console>
Nov 24 10:23:51 user nova-compute[75073]:     <input type='mouse' bus='ps2'>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='input0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </input>
Nov 24 10:23:51 user nova-compute[75073]:     <input type='keyboard' bus='ps2'>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='input1'/>
Nov 24 10:23:51 user nova-compute[75073]:     </input>
Nov 24 10:23:51 user nova-compute[75073]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 10:23:51 user nova-compute[75073]:       <listen type='address' address='0.0.0.0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </graphics>
Nov 24 10:23:51 user nova-compute[75073]:     <audio id='1' type='none'/>
Nov 24 10:23:51 user nova-compute[75073]:     <video>
Nov 24 10:23:51 user nova-compute[75073]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='video0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </video>
Nov 24 10:23:51 user nova-compute[75073]:     <memballoon model='virtio'>
Nov 24 10:23:51 user nova-compute[75073]:       <stats period='10'/>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='balloon0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </memballoon>
Nov 24 10:23:51 user nova-compute[75073]:     <rng model='virtio'>
Nov 24 10:23:51 user nova-compute[75073]:       <backend model='random'>/dev/urandom</backend>
Nov 24 10:23:51 user nova-compute[75073]:       <alias name='rng0'/>
Nov 24 10:23:51 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 10:23:51 user nova-compute[75073]:     </rng>
Nov 24 10:23:51 user nova-compute[75073]:   </devices>
Nov 24 10:23:51 user nova-compute[75073]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 10:23:51 user nova-compute[75073]:     <label>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</label>
Nov 24 10:23:51 user nova-compute[75073]:     <imagelabel>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</imagelabel>
Nov 24 10:23:51 user nova-compute[75073]:   </seclabel>
Nov 24 10:23:51 user nova-compute[75073]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 10:23:51 user nova-compute[75073]:     <label>+64055:+108</label>
Nov 24 10:23:51 user nova-compute[75073]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 10:23:51 user nova-compute[75073]:   </seclabel>
Nov 24 10:23:51 user nova-compute[75073]: </domain>
Nov 24 10:23:51 user nova-compute[75073]:  {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 10:23:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully detached device tap14dead6a-e6 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the persistent domain config.
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] (1/8): Attempting to detach device tap14dead6a-e6 with device alias net1 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] detach device xml: <interface type="ethernet">
Nov 24 10:23:51 user nova-compute[75073]:   <mac address="fa:16:3e:bf:22:38"/>
Nov 24 10:23:51 user nova-compute[75073]:   <model type="virtio"/>
Nov 24 10:23:51 user nova-compute[75073]:   <mtu size="1442"/>
Nov 24 10:23:51 user nova-compute[75073]:   <target dev="tap14dead6a-e6"/>
Nov 24 10:23:51 user nova-compute[75073]: </interface>
Nov 24 10:23:51 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MVHCTsZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:51 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591c460-09eb-4f1b-af4e-9a2cfb400492]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:51 user nova-compute[75073]: No targets found.
Nov 24 10:23:51 user nova-compute[75073]: iSNS:
Nov 24 10:23:51 user nova-compute[75073]: No targets found.
Nov 24 10:23:51 user nova-compute[75073]: STATIC:
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:51 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:51 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:51 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:51 user nova-compute[75073]: No targets found.
Nov 24 10:23:51 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:51 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:51 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b2274-cb41-4f2d-a5e2-0d0e8df18de6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5bc08b-32f2-4e47-b41d-e7a4fbe45055]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:51 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:51 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b'): ({'sdk'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Removing single pathed devices sdk {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb98f96-668e-44d3-aae6-7190483fc011]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694c420-bd59-4069-9dac-56f99c91cded]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Flushing IO for device /dev/sdk {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[660621ff-e79e-4e5e-a908-3a89515feb54]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Start waiting for the detach event from libvirt for device tap14dead6a-e6 with device alias net1 for instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a677a19-5a56-40c4-a270-f18f3c19dedc]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] SCSI volumes sdk have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3a510-246e-4cce-8f9f-3be8aa2f83df]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438ba55-1ac4-4b59-a3f4-05c37e36d08b]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260]
Nov 24 10:23:52 user nova-compute[75073]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-unplugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-unplugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:52 user nova-compute[75073]: WARNING nova.compute.manager [req-7e55c448-f8d0-4c56-ab81-71be92baf9a7 req-86e803f4-8c9b-46ee-bd13-7e36fbc8959d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-unplugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 for instance with vm_state active and task_state None.
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[867bc5b6-1d07-4425-b439-6be3443165ec]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] <== disconnect_volume: return (419ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fb7cefcf-9df1-4174-b68c-addb1af850a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2064dc83-8441-4f54-bc65-3d63b47f23f1', 'serial'} {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: removing Cinder connection for volume 5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b {{(pid=75073) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 24 10:23:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:23:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] swap_volume: Updating volume 5fef79fb-fc8a-4f80-86e1-ae0aeccf8a1b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "qJUgNYXI", "auth_password": "7ExawAz2Hm1Xtq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "2064dc83-8441-4f54-bc65-3d63b47f23f1"}, "status": "reserved", "instance": "fb7cefcf-9df1-4174-b68c-addb1af850a0", "attached_at": "", "detached_at": "", "volume_id": "2064dc83-8441-4f54-bc65-3d63b47f23f1", "serial": "2064dc83-8441-4f54-bc65-3d63b47f23f1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2064dc83-8441-4f54-bc65-3d63b47f23f1', 'no_device': None, 'attachment_id': 'd3d2c774-03d1-4fdf-89ba-7904058ce21e'} {{(pid=75073) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 24 10:23:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8eebd3ce-5749-4e1e-bfbf-893a87960acf tempest-TestVolumeSwap-2056180939 tempest-TestVolumeSwap-2056180939-project-admin] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.645s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:54 user nova-compute[75073]: INFO nova.compute.manager [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Detaching volume 2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:54 user nova-compute[75073]: INFO nova.virt.block_device [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Attempting to driver detach volume 2064dc83-8441-4f54-bc65-3d63b47f23f1 from mountpoint /dev/vdb
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Attempting to detach device vdb from instance fb7cefcf-9df1-4174-b68c-addb1af850a0 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:54 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:23:54 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:54 user nova-compute[75073]:   <serial>2064dc83-8441-4f54-bc65-3d63b47f23f1</serial>
Nov 24 10:23:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:54 user nova-compute[75073]: </disk>
Nov 24 10:23:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Successfully detached device vdb from instance fb7cefcf-9df1-4174-b68c-addb1af850a0 from the persistent domain config.
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb7cefcf-9df1-4174-b68c-addb1af850a0 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:23:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:23:54 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:23:54 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:23:54 user nova-compute[75073]:   <serial>2064dc83-8441-4f54-bc65-3d63b47f23f1</serial>
Nov 24 10:23:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:23:54 user nova-compute[75073]: </disk>
Nov 24 10:23:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:23:54 user nova-compute[75073]: WARNING nova.compute.manager [req-fb3a1414-6ec6-471b-8217-65855437116c req-d8137dcc-1d45-49ca-9488-07753ea0857d service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-14dead6a-e61b-4e0b-bf98-8e724992bbb7 for instance with vm_state active and task_state None.
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:23:54 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 is timed out.
Nov 24 10:23:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Successfully detached device vdb from instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 from the live domain config.
Nov 24 10:23:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idWkNpRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:54 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e564a-7041-433a-b0af-3519e335c6c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:23:54 user nova-compute[75073]: No targets found.
Nov 24 10:23:54 user nova-compute[75073]: iSNS:
Nov 24 10:23:54 user nova-compute[75073]: No targets found.
Nov 24 10:23:54 user nova-compute[75073]: STATIC:
Nov 24 10:23:54 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:23:54 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:54 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:54 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:23:54 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:54 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:54 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:23:54 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:54 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:54 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18
Nov 24 10:23:54 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:54 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:54 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:23:54 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:23:54 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:23:54 user nova-compute[75073]: FIRMWARE:
Nov 24 10:23:54 user nova-compute[75073]: No targets found.
Nov 24 10:23:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:23:54 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:23:54 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdba7b-bc89-4548-ac94-5055db8614be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b4062-5211-415c-9eda-c32725c2a45f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:54 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383f2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18'): ({'sdi'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Removing single pathed devices sdi {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[426675d1-76bc-4760-92e6-da3e5edaed62]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae27510e-fcfe-402a-8235-373cfed24d53]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Flushing IO for device /dev/sdi {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d541be-22ab-4222-94bf-f3941e3326a2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded9496-8824-4124-af52-a0b3fab2617e]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] SCSI volumes sdi have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:23:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3f27e-b52f-423f-9fdb-d1033a8d218e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae27bf9-d476-40e6-96a1-17840ec76089]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260]
Nov 24 10:23:55 user nova-compute[75073]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd438934-60aa-408f-9357-55a3fddddb18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff2fca-a108-4e7d-bddf-18be3d936580]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] <== disconnect_volume: return (342ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lazy-loading 'flavor' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fe9b0750-4560-4cff-a788-946d1b9c0890 tempest-VolumesAssistedSnapshotsTest-60762295 tempest-VolumesAssistedSnapshotsTest-60762295-project-admin] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:23:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Creating image(s)
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Ensure instance console log exists: /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start _get_guest_xml network_info=[{"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '2f1809ad-b381-4c45-abf6-7b76bbd12a07', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff8e177f-6cf4-4f93-b997-13ffacce99f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c219be38-d43f-46f2-b035-d18e8225d603', 'serial': 'c219be38-d43f-46f2-b035-d18e8225d603'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:23:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 10:23:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff8e177f-6cf4-4f93-b997-13ffacce99f1 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:23:59 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:59 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:23:59 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1ac9d-1888-4654-9bb4-16c8d8831169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:23:59 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[134cc655-3362-4216-b389-dc12a6d0ec65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603] added
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.076s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3122f2-f6cb-4451-a66b-6e1d51f549e6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[433da009-da3b-4a5d-acc4-b2456d9e46c3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPoZXVSb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nPoZXVSb" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00d3b33-d50e-41d8-a799-9a31dfc4fd7e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nPoZXVSb'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f134a1-ac2b-469b-bbe5-7a317d6877cf]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b45fb3-44ec-4e57-b6e1-eb22430f888e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cce7e6-13ec-4e71-abfc-86e3bb102d08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]
Nov 24 10:23:59 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aeeb8a-a4f2-4cbd-a437-51e4243e9c16]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9a96b-870a-42f1-8144-d4148589f8a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:23:59 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:23:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1af43-8f53-4a3d-869f-66bac07c9e51]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:23:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23537323234353436', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537323234353436', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478155882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:24:00 user nova-compute[75073]:   <uuid>ff8e177f-6cf4-4f93-b997-13ffacce99f1</uuid>
Nov 24 10:24:00 user nova-compute[75073]:   <name>instance-00000007</name>
Nov 24 10:24:00 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:24:00 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:24:00 user nova-compute[75073]:   <metadata>
Nov 24 10:24:00 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:00 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:24:00 user nova-compute[75073]:       <nova:name>tempest-ServerActionsV293TestJSON-server-478155882</nova:name>
Nov 24 10:24:00 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:23:59</nova:creationTime>
Nov 24 10:24:00 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:24:00 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:00 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:24:00 user nova-compute[75073]:       <nova:owner>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:user uuid="92552b1336c84ed3a664b4e081c1ab19">tempest-ServerActionsV293TestJSON-834413643-project-member</nova:user>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:project uuid="b0d54989ce7c43ed9591752dfca4b618">tempest-ServerActionsV293TestJSON-834413643</nova:project>
Nov 24 10:24:00 user nova-compute[75073]:       </nova:owner>
Nov 24 10:24:00 user nova-compute[75073]:       <nova:ports>
Nov 24 10:24:00 user nova-compute[75073]:         <nova:port uuid="fcf31f42-7b47-49a6-be6a-83eda2801879">
Nov 24 10:24:00 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:24:00 user nova-compute[75073]:         </nova:port>
Nov 24 10:24:00 user nova-compute[75073]:       </nova:ports>
Nov 24 10:24:00 user nova-compute[75073]:     </nova:instance>
Nov 24 10:24:00 user nova-compute[75073]:   </metadata>
Nov 24 10:24:00 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:24:00 user nova-compute[75073]:     <system>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="serial">ff8e177f-6cf4-4f93-b997-13ffacce99f1</entry>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="uuid">ff8e177f-6cf4-4f93-b997-13ffacce99f1</entry>
Nov 24 10:24:00 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:24:00 user nova-compute[75073]:     </system>
Nov 24 10:24:00 user nova-compute[75073]:   </sysinfo>
Nov 24 10:24:00 user nova-compute[75073]:   <os>
Nov 24 10:24:00 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:24:00 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:24:00 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:24:00 user nova-compute[75073]:   </os>
Nov 24 10:24:00 user nova-compute[75073]:   <features>
Nov 24 10:24:00 user nova-compute[75073]:     <acpi/>
Nov 24 10:24:00 user nova-compute[75073]:     <apic/>
Nov 24 10:24:00 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:24:00 user nova-compute[75073]:   </features>
Nov 24 10:24:00 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:24:00 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:24:00 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:24:00 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:24:00 user nova-compute[75073]:   </clock>
Nov 24 10:24:00 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:24:00 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:24:00 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:24:00 user nova-compute[75073]:   </cpu>
Nov 24 10:24:00 user nova-compute[75073]:   <devices>
Nov 24 10:24:00 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:24:00 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:24:00 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:24:00 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:24:00 user nova-compute[75073]:       <serial>c219be38-d43f-46f2-b035-d18e8225d603</serial>
Nov 24 10:24:00 user nova-compute[75073]:     </disk>
Nov 24 10:24:00 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:24:00 user nova-compute[75073]:       <mac address="fa:16:3e:bf:c2:ed"/>
Nov 24 10:24:00 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:24:00 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:24:00 user nova-compute[75073]:       <target dev="tapfcf31f42-7b"/>
Nov 24 10:24:00 user nova-compute[75073]:     </interface>
Nov 24 10:24:00 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:24:00 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1/console.log" append="off"/>
Nov 24 10:24:00 user nova-compute[75073]:     </serial>
Nov 24 10:24:00 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:24:00 user nova-compute[75073]:     <video>
Nov 24 10:24:00 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:24:00 user nova-compute[75073]:     </video>
Nov 24 10:24:00 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:24:00 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:24:00 user nova-compute[75073]:     </rng>
Nov 24 10:24:00 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:24:00 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:24:00 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:24:00 user nova-compute[75073]:     </memballoon>
Nov 24 10:24:00 user nova-compute[75073]:   </devices>
Nov 24 10:24:00 user nova-compute[75073]: </domain>
Nov 24 10:24:00 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478155882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG os_vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22c67f70-f642-5335-b3ba-28ea8781c6e3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf31f42-7b, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf31f42-7b, col_values=(('qos', UUID('a08a109f-7f70-4791-a280-e5db053509df')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf31f42-7b, col_values=(('external_ids', {'iface-id': 'fcf31f42-7b47-49a6-be6a-83eda2801879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c2:ed', 'vm-uuid': 'ff8e177f-6cf4-4f93-b997-13ffacce99f1'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:01 user nova-compute[75073]: INFO os_vif [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b')
Nov 24 10:24:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:24:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] No VIF found with MAC fa:16:3e:bf:c2:ed, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:02 user nova-compute[75073]: WARNING nova.compute.manager [req-99c69f15-5662-4f87-b5e2-74182ee6a588 req-c5414bec-71e4-43cc-bacd-ffea176a0e52 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state active and task_state rebuild_spawning.
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:24:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance spawned successfully.
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:04 user nova-compute[75073]: WARNING nova.compute.manager [req-c4ddf4ba-00ba-4652-be2f-d0e1bf095709 req-04569bd1-82e4-4340-9761-50f5ed748588 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state active and task_state None.
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75073) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 24 10:24:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-07ae6e14-4653-4d42-9df8-a99a8054ff13 tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:24:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Waiting for libvirt event about the detach of device tap14dead6a-e6 with device alias net1 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 is timed out.
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 10:24:12 user nova-compute[75073]:   <name>instance-00000006</name>
Nov 24 10:24:12 user nova-compute[75073]:   <uuid>b745dbf9-0dc2-4d1a-b709-d48422e9a537</uuid>
Nov 24 10:24:12 user nova-compute[75073]:   <metadata>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:12 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:23:08</nova:creationTime>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:24:12 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:ports>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="14dead6a-e61b-4e0b-bf98-8e724992bbb7">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.10.10.105" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:ports>
Nov 24 10:24:12 user nova-compute[75073]: </nova:instance>
Nov 24 10:24:12 user nova-compute[75073]:   </metadata>
Nov 24 10:24:12 user nova-compute[75073]:   <memory unit='KiB'>524288</memory>
Nov 24 10:24:12 user nova-compute[75073]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 10:24:12 user nova-compute[75073]:   <vcpu placement='static'>1</vcpu>
Nov 24 10:24:12 user nova-compute[75073]:   <resource>
Nov 24 10:24:12 user nova-compute[75073]:     <partition>/machine</partition>
Nov 24 10:24:12 user nova-compute[75073]:   </resource>
Nov 24 10:24:12 user nova-compute[75073]:   <sysinfo type='smbios'>
Nov 24 10:24:12 user nova-compute[75073]:     <system>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='version'>0.0.0</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='serial'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='uuid'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='family'>Virtual Machine</entry>
Nov 24 10:24:12 user nova-compute[75073]:     </system>
Nov 24 10:24:12 user nova-compute[75073]:   </sysinfo>
Nov 24 10:24:12 user nova-compute[75073]:   <os>
Nov 24 10:24:12 user nova-compute[75073]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 10:24:12 user nova-compute[75073]:     <boot dev='hd'/>
Nov 24 10:24:12 user nova-compute[75073]:     <smbios mode='sysinfo'/>
Nov 24 10:24:12 user nova-compute[75073]:   </os>
Nov 24 10:24:12 user nova-compute[75073]:   <features>
Nov 24 10:24:12 user nova-compute[75073]:     <acpi/>
Nov 24 10:24:12 user nova-compute[75073]:     <apic/>
Nov 24 10:24:12 user nova-compute[75073]:     <vmcoreinfo state='on'/>
Nov 24 10:24:12 user nova-compute[75073]:   </features>
Nov 24 10:24:12 user nova-compute[75073]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 10:24:12 user nova-compute[75073]:     <model fallback='forbid'>Nehalem</model>
Nov 24 10:24:12 user nova-compute[75073]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='vme'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='x2apic'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='hypervisor'/>
Nov 24 10:24:12 user nova-compute[75073]:   </cpu>
Nov 24 10:24:12 user nova-compute[75073]:   <clock offset='utc'>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='hpet' present='no'/>
Nov 24 10:24:12 user nova-compute[75073]:   </clock>
Nov 24 10:24:12 user nova-compute[75073]:   <on_poweroff>destroy</on_poweroff>
Nov 24 10:24:12 user nova-compute[75073]:   <on_reboot>restart</on_reboot>
Nov 24 10:24:12 user nova-compute[75073]:   <on_crash>destroy</on_crash>
Nov 24 10:24:12 user nova-compute[75073]:   <devices>
Nov 24 10:24:12 user nova-compute[75073]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='disk'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk' index='2'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore type='file' index='3'>
Nov 24 10:24:12 user nova-compute[75073]:         <format type='raw'/>
Nov 24 10:24:12 user nova-compute[75073]:         <source file='/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b'/>
Nov 24 10:24:12 user nova-compute[75073]:         <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       </backingStore>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='vda' bus='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='virtio-disk0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='cdrom'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config' index='1'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='hda' bus='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <readonly/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide0-0-0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='usb' index='0' model='none'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='usb'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='pci.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='ide' index='0'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <interface type='ethernet'>
Nov 24 10:24:12 user nova-compute[75073]:       <mac address='fa:16:3e:74:6e:7f'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='tapec1d3f24-31'/>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <mtu size='1442'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='net0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </interface>
Nov 24 10:24:12 user nova-compute[75073]:     <serial type='pty'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='isa-serial' port='0'>
Nov 24 10:24:12 user nova-compute[75073]:         <model name='isa-serial'/>
Nov 24 10:24:12 user nova-compute[75073]:       </target>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </serial>
Nov 24 10:24:12 user nova-compute[75073]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='serial' port='0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </console>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='mouse' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='keyboard' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 10:24:12 user nova-compute[75073]:       <listen type='address' address='0.0.0.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </graphics>
Nov 24 10:24:12 user nova-compute[75073]:     <audio id='1' type='none'/>
Nov 24 10:24:12 user nova-compute[75073]:     <video>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='video0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </video>
Nov 24 10:24:12 user nova-compute[75073]:     <memballoon model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <stats period='10'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='balloon0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </memballoon>
Nov 24 10:24:12 user nova-compute[75073]:     <rng model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <backend model='random'>/dev/urandom</backend>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='rng0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </rng>
Nov 24 10:24:12 user nova-compute[75073]:   </devices>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>+64055:+108</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]: </domain>
Nov 24 10:24:12 user nova-compute[75073]:  {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 10:24:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully detached device tap14dead6a-e6 from instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 from the live domain config.
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG os_vif [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14dead6a-e6, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35653c0e-b817-44ef-b1cd-4890ca25f47a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:12 user nova-compute[75073]: INFO os_vif [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6')
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:12 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:24:12</nova:creationTime>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:24:12 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:ports>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:ports>
Nov 24 10:24:12 user nova-compute[75073]: </nova:instance>
Nov 24 10:24:12 user nova-compute[75073]:  {{(pid=75073) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-deleted-14dead6a-e61b-4e0b-bf98-8e724992bbb7 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:12 user nova-compute[75073]: INFO nova.compute.manager [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Neutron deleted interface 14dead6a-e61b-4e0b-bf98-8e724992bbb7; detaching it from the instance and deleting it from the info cache
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquired lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.objects.instance [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Lazy-loading 'system_metadata' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.objects.instance [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Lazy-loading 'flavor' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.objects.base [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Object Instance<b745dbf9-0dc2-4d1a-b709-d48422e9a537> lazy-loaded attributes: system_metadata,flavor {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 10:24:12 user nova-compute[75073]:   <name>instance-00000006</name>
Nov 24 10:24:12 user nova-compute[75073]:   <uuid>b745dbf9-0dc2-4d1a-b709-d48422e9a537</uuid>
Nov 24 10:24:12 user nova-compute[75073]:   <metadata>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:12 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:24:12</nova:creationTime>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:24:12 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:ports>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:ports>
Nov 24 10:24:12 user nova-compute[75073]: </nova:instance>
Nov 24 10:24:12 user nova-compute[75073]:   </metadata>
Nov 24 10:24:12 user nova-compute[75073]:   <memory unit='KiB'>524288</memory>
Nov 24 10:24:12 user nova-compute[75073]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 10:24:12 user nova-compute[75073]:   <vcpu placement='static'>1</vcpu>
Nov 24 10:24:12 user nova-compute[75073]:   <resource>
Nov 24 10:24:12 user nova-compute[75073]:     <partition>/machine</partition>
Nov 24 10:24:12 user nova-compute[75073]:   </resource>
Nov 24 10:24:12 user nova-compute[75073]:   <sysinfo type='smbios'>
Nov 24 10:24:12 user nova-compute[75073]:     <system>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='version'>0.0.0</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='serial'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='uuid'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='family'>Virtual Machine</entry>
Nov 24 10:24:12 user nova-compute[75073]:     </system>
Nov 24 10:24:12 user nova-compute[75073]:   </sysinfo>
Nov 24 10:24:12 user nova-compute[75073]:   <os>
Nov 24 10:24:12 user nova-compute[75073]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 10:24:12 user nova-compute[75073]:     <boot dev='hd'/>
Nov 24 10:24:12 user nova-compute[75073]:     <smbios mode='sysinfo'/>
Nov 24 10:24:12 user nova-compute[75073]:   </os>
Nov 24 10:24:12 user nova-compute[75073]:   <features>
Nov 24 10:24:12 user nova-compute[75073]:     <acpi/>
Nov 24 10:24:12 user nova-compute[75073]:     <apic/>
Nov 24 10:24:12 user nova-compute[75073]:     <vmcoreinfo state='on'/>
Nov 24 10:24:12 user nova-compute[75073]:   </features>
Nov 24 10:24:12 user nova-compute[75073]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 10:24:12 user nova-compute[75073]:     <model fallback='forbid'>Nehalem</model>
Nov 24 10:24:12 user nova-compute[75073]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='vme'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='x2apic'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='hypervisor'/>
Nov 24 10:24:12 user nova-compute[75073]:   </cpu>
Nov 24 10:24:12 user nova-compute[75073]:   <clock offset='utc'>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='hpet' present='no'/>
Nov 24 10:24:12 user nova-compute[75073]:   </clock>
Nov 24 10:24:12 user nova-compute[75073]:   <on_poweroff>destroy</on_poweroff>
Nov 24 10:24:12 user nova-compute[75073]:   <on_reboot>restart</on_reboot>
Nov 24 10:24:12 user nova-compute[75073]:   <on_crash>destroy</on_crash>
Nov 24 10:24:12 user nova-compute[75073]:   <devices>
Nov 24 10:24:12 user nova-compute[75073]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='disk'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk' index='2'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore type='file' index='3'>
Nov 24 10:24:12 user nova-compute[75073]:         <format type='raw'/>
Nov 24 10:24:12 user nova-compute[75073]:         <source file='/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b'/>
Nov 24 10:24:12 user nova-compute[75073]:         <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       </backingStore>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='vda' bus='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='virtio-disk0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='cdrom'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config' index='1'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='hda' bus='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <readonly/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide0-0-0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='usb' index='0' model='none'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='usb'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='pci.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='ide' index='0'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <interface type='ethernet'>
Nov 24 10:24:12 user nova-compute[75073]:       <mac address='fa:16:3e:74:6e:7f'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='tapec1d3f24-31'/>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <mtu size='1442'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='net0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </interface>
Nov 24 10:24:12 user nova-compute[75073]:     <serial type='pty'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='isa-serial' port='0'>
Nov 24 10:24:12 user nova-compute[75073]:         <model name='isa-serial'/>
Nov 24 10:24:12 user nova-compute[75073]:       </target>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </serial>
Nov 24 10:24:12 user nova-compute[75073]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='serial' port='0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </console>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='mouse' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='keyboard' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 10:24:12 user nova-compute[75073]:       <listen type='address' address='0.0.0.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </graphics>
Nov 24 10:24:12 user nova-compute[75073]:     <audio id='1' type='none'/>
Nov 24 10:24:12 user nova-compute[75073]:     <video>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='video0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </video>
Nov 24 10:24:12 user nova-compute[75073]:     <memballoon model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <stats period='10'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='balloon0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </memballoon>
Nov 24 10:24:12 user nova-compute[75073]:     <rng model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <backend model='random'>/dev/urandom</backend>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='rng0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </rng>
Nov 24 10:24:12 user nova-compute[75073]:   </devices>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>+64055:+108</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]: </domain>
Nov 24 10:24:12 user nova-compute[75073]:  {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface> {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:bf:22:38"/><model type="virtio"/><mtu size="1442"/><target dev="tap14dead6a-e6"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 10:24:12 user nova-compute[75073]:   <name>instance-00000006</name>
Nov 24 10:24:12 user nova-compute[75073]:   <uuid>b745dbf9-0dc2-4d1a-b709-d48422e9a537</uuid>
Nov 24 10:24:12 user nova-compute[75073]:   <metadata>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:12 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:24:12</nova:creationTime>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:24:12 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:ports>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:ports>
Nov 24 10:24:12 user nova-compute[75073]: </nova:instance>
Nov 24 10:24:12 user nova-compute[75073]:   </metadata>
Nov 24 10:24:12 user nova-compute[75073]:   <memory unit='KiB'>524288</memory>
Nov 24 10:24:12 user nova-compute[75073]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 10:24:12 user nova-compute[75073]:   <vcpu placement='static'>1</vcpu>
Nov 24 10:24:12 user nova-compute[75073]:   <resource>
Nov 24 10:24:12 user nova-compute[75073]:     <partition>/machine</partition>
Nov 24 10:24:12 user nova-compute[75073]:   </resource>
Nov 24 10:24:12 user nova-compute[75073]:   <sysinfo type='smbios'>
Nov 24 10:24:12 user nova-compute[75073]:     <system>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='version'>0.0.0</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='serial'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='uuid'>b745dbf9-0dc2-4d1a-b709-d48422e9a537</entry>
Nov 24 10:24:12 user nova-compute[75073]:       <entry name='family'>Virtual Machine</entry>
Nov 24 10:24:12 user nova-compute[75073]:     </system>
Nov 24 10:24:12 user nova-compute[75073]:   </sysinfo>
Nov 24 10:24:12 user nova-compute[75073]:   <os>
Nov 24 10:24:12 user nova-compute[75073]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 10:24:12 user nova-compute[75073]:     <boot dev='hd'/>
Nov 24 10:24:12 user nova-compute[75073]:     <smbios mode='sysinfo'/>
Nov 24 10:24:12 user nova-compute[75073]:   </os>
Nov 24 10:24:12 user nova-compute[75073]:   <features>
Nov 24 10:24:12 user nova-compute[75073]:     <acpi/>
Nov 24 10:24:12 user nova-compute[75073]:     <apic/>
Nov 24 10:24:12 user nova-compute[75073]:     <vmcoreinfo state='on'/>
Nov 24 10:24:12 user nova-compute[75073]:   </features>
Nov 24 10:24:12 user nova-compute[75073]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 10:24:12 user nova-compute[75073]:     <model fallback='forbid'>Nehalem</model>
Nov 24 10:24:12 user nova-compute[75073]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='vme'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='x2apic'/>
Nov 24 10:24:12 user nova-compute[75073]:     <feature policy='require' name='hypervisor'/>
Nov 24 10:24:12 user nova-compute[75073]:   </cpu>
Nov 24 10:24:12 user nova-compute[75073]:   <clock offset='utc'>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 10:24:12 user nova-compute[75073]:     <timer name='hpet' present='no'/>
Nov 24 10:24:12 user nova-compute[75073]:   </clock>
Nov 24 10:24:12 user nova-compute[75073]:   <on_poweroff>destroy</on_poweroff>
Nov 24 10:24:12 user nova-compute[75073]:   <on_reboot>restart</on_reboot>
Nov 24 10:24:12 user nova-compute[75073]:   <on_crash>destroy</on_crash>
Nov 24 10:24:12 user nova-compute[75073]:   <devices>
Nov 24 10:24:12 user nova-compute[75073]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='disk'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk' index='2'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore type='file' index='3'>
Nov 24 10:24:12 user nova-compute[75073]:         <format type='raw'/>
Nov 24 10:24:12 user nova-compute[75073]:         <source file='/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b'/>
Nov 24 10:24:12 user nova-compute[75073]:         <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       </backingStore>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='vda' bus='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='virtio-disk0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <disk type='file' device='cdrom'>
Nov 24 10:24:12 user nova-compute[75073]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 10:24:12 user nova-compute[75073]:       <source file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk.config' index='1'/>
Nov 24 10:24:12 user nova-compute[75073]:       <backingStore/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='hda' bus='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <readonly/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide0-0-0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </disk>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='usb' index='0' model='none'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='usb'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='pci.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <controller type='ide' index='0'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='ide'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </controller>
Nov 24 10:24:12 user nova-compute[75073]:     <interface type='ethernet'>
Nov 24 10:24:12 user nova-compute[75073]:       <mac address='fa:16:3e:74:6e:7f'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target dev='tapec1d3f24-31'/>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio'/>
Nov 24 10:24:12 user nova-compute[75073]:       <mtu size='1442'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='net0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </interface>
Nov 24 10:24:12 user nova-compute[75073]:     <serial type='pty'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='isa-serial' port='0'>
Nov 24 10:24:12 user nova-compute[75073]:         <model name='isa-serial'/>
Nov 24 10:24:12 user nova-compute[75073]:       </target>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </serial>
Nov 24 10:24:12 user nova-compute[75073]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 10:24:12 user nova-compute[75073]:       <source path='/dev/pts/5'/>
Nov 24 10:24:12 user nova-compute[75073]:       <log file='/opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/console.log' append='off'/>
Nov 24 10:24:12 user nova-compute[75073]:       <target type='serial' port='0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='serial0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </console>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='mouse' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <input type='keyboard' bus='ps2'>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='input1'/>
Nov 24 10:24:12 user nova-compute[75073]:     </input>
Nov 24 10:24:12 user nova-compute[75073]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 10:24:12 user nova-compute[75073]:       <listen type='address' address='0.0.0.0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </graphics>
Nov 24 10:24:12 user nova-compute[75073]:     <audio id='1' type='none'/>
Nov 24 10:24:12 user nova-compute[75073]:     <video>
Nov 24 10:24:12 user nova-compute[75073]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='video0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </video>
Nov 24 10:24:12 user nova-compute[75073]:     <memballoon model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <stats period='10'/>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='balloon0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </memballoon>
Nov 24 10:24:12 user nova-compute[75073]:     <rng model='virtio'>
Nov 24 10:24:12 user nova-compute[75073]:       <backend model='random'>/dev/urandom</backend>
Nov 24 10:24:12 user nova-compute[75073]:       <alias name='rng0'/>
Nov 24 10:24:12 user nova-compute[75073]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 10:24:12 user nova-compute[75073]:     </rng>
Nov 24 10:24:12 user nova-compute[75073]:   </devices>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>libvirt-b745dbf9-0dc2-4d1a-b709-d48422e9a537</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 10:24:12 user nova-compute[75073]:     <label>+64055:+108</label>
Nov 24 10:24:12 user nova-compute[75073]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 10:24:12 user nova-compute[75073]:   </seclabel>
Nov 24 10:24:12 user nova-compute[75073]: </domain>
Nov 24 10:24:12 user nova-compute[75073]:  {{(pid=75073) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 10:24:12 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Detaching interface fa:16:3e:bf:22:38 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap14dead6a-e6' not found.
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Converting VIF {"id": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "address": "fa:16:3e:bf:22:38", "network": {"id": "cd8c027e-c835-4b5e-adb8-15953580ea25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1411039933", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14dead6a-e6", "ovs_interfaceid": "14dead6a-e61b-4e0b-bf98-8e724992bbb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG os_vif [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14dead6a-e6, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:24:12 user nova-compute[75073]: INFO os_vif [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:22:38,bridge_name='br-int',has_traffic_filtering=True,id=14dead6a-e61b-4e0b-bf98-8e724992bbb7,network=Network(cd8c027e-c835-4b5e-adb8-15953580ea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14dead6a-e6')
Nov 24 10:24:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [req-2cdd8565-9a38-41e3-ad9f-a9a7a1ab24f8 req-c5b1faf0-6580-485d-8f79-830ef4e629e3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:12 user nova-compute[75073]:   <nova:package version="0.0.0"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:name>tempest-device-tagging-server-1772667118</nova:name>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:creationTime>2023-11-24 10:24:12</nova:creationTime>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:flavor name="m1.tiny">
Nov 24 10:24:12 user nova-compute[75073]:     <nova:memory>512</nova:memory>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:disk>1</nova:disk>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:swap>0</nova:swap>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:flavor>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:user uuid="eeb6e6c16c4c4638a91632bee60f3bd1">tempest-TaggedAttachmentsTest-846416394-project-member</nova:user>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:project uuid="bdeb11f3d47f45c7a467c206134af82f">tempest-TaggedAttachmentsTest-846416394</nova:project>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:owner>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:12 user nova-compute[75073]:   <nova:ports>
Nov 24 10:24:12 user nova-compute[75073]:     <nova:port uuid="ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c">
Nov 24 10:24:12 user nova-compute[75073]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:24:12 user nova-compute[75073]:     </nova:port>
Nov 24 10:24:12 user nova-compute[75073]:   </nova:ports>
Nov 24 10:24:12 user nova-compute[75073]: </nova:instance>
Nov 24 10:24:12 user nova-compute[75073]:  {{(pid=75073) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [{"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Releasing lock "refresh_cache-b745dbf9-0dc2-4d1a-b709-d48422e9a537" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b9bd9a76-5894-4855-9f01-dd5e2876468f tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "interface-b745dbf9-0dc2-4d1a-b709-d48422e9a537-14dead6a-e61b-4e0b-bf98-8e724992bbb7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.746s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:24:13 user nova-compute[75073]: INFO nova.compute.claims [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Claim successful on node user
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:24:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:24:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.policy [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09ba54648b745e6a09eed8514b7376a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcfd0f8a9fe42ada311dcc1047b3c79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:24:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Creating image(s)
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "/opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "/opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "/opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Successfully created port: 0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk 1073741824" returned: 0 in 0.053s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb7cefcf-9df1-4174-b68c-addb1af850a0 is timed out.
Nov 24 10:24:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Successfully detached device vdb from instance fb7cefcf-9df1-4174-b68c-addb1af850a0 from the live domain config.
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJUgNYXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '2064dc83-8441-4f54-bc65-3d63b47f23f1'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:24:14 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc61d8d-55ca-41f4-a6fd-8f587a5ca508]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:24:14 user nova-compute[75073]: No targets found.
Nov 24 10:24:14 user nova-compute[75073]: iSNS:
Nov 24 10:24:14 user nova-compute[75073]: No targets found.
Nov 24 10:24:14 user nova-compute[75073]: STATIC:
Nov 24 10:24:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:24:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:24:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1
Nov 24 10:24:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:24:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:24:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:14 user nova-compute[75073]: FIRMWARE:
Nov 24 10:24:14 user nova-compute[75073]: No targets found.
Nov 24 10:24:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:24:14 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:24:14 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20463a31-754c-479b-902c-cd805a7f5f47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf14a70-d840-4d16-a889-6685f6725e19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:24:14 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383e15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f3422-ae68-4407-a589-13fb87d61932]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5488e0-14ec-4e76-9cba-ef0c30942088]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82829be-6e9c-4d3a-8a5f-689bef6f4981]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:24:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69d4b2-9cd2-4f7a-a3e8-8d2b13688772]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Cannot resize image /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Ensure instance console log exists: /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8780dd-b7f7-4594-86f5-33b0b0685d30]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[76754e6a-28cf-4dfd-bccf-6c822d992e97]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260]
Nov 24 10:24:15 user nova-compute[75073]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1, portal: 172.16.0.220,3260] successful.
Nov 24 10:24:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2064dc83-8441-4f54-bc65-3d63b47f23f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2171d4-a81b-4348-9e40-a91150e1540c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] <== disconnect_volume: return (418ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Successfully updated port: 0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquired lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-changed-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Refreshing instance network info cache due to event network-changed-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] Acquiring lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Updating instance_info_cache with network_info: [{"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Releasing lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Instance network_info: |[{"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] Acquired lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Refreshing network info cache for port 0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Start _get_guest_xml network_info=[{"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:24:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:24:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1855524810',display_name='tempest-VolumesAdminNegativeTest-server-1855524810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1855524810',id=11,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-z0ivi9c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:24:14Z,user_data=None,user_id='a09ba54648b745e6a09eed8514b7376a',uuid=78f066a7-6d92-4161-a720-0eb2ae5cea72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.objects.instance [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'pci_devices' on Instance uuid 78f066a7-6d92-4161-a720-0eb2ae5cea72 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:24:15 user nova-compute[75073]:   <uuid>78f066a7-6d92-4161-a720-0eb2ae5cea72</uuid>
Nov 24 10:24:15 user nova-compute[75073]:   <name>instance-0000000b</name>
Nov 24 10:24:15 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:24:15 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:24:15 user nova-compute[75073]:   <metadata>
Nov 24 10:24:15 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:24:15 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1855524810</nova:name>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:24:15</nova:creationTime>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:24:15 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:24:15 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:owner>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:user uuid="a09ba54648b745e6a09eed8514b7376a">tempest-VolumesAdminNegativeTest-1494900621-project-member</nova:user>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:project uuid="8bcfd0f8a9fe42ada311dcc1047b3c79">tempest-VolumesAdminNegativeTest-1494900621</nova:project>
Nov 24 10:24:15 user nova-compute[75073]:       </nova:owner>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:24:15 user nova-compute[75073]:       <nova:ports>
Nov 24 10:24:15 user nova-compute[75073]:         <nova:port uuid="0dd30b3c-f96f-43fe-9d4f-6de8d5e771de">
Nov 24 10:24:15 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 10:24:15 user nova-compute[75073]:         </nova:port>
Nov 24 10:24:15 user nova-compute[75073]:       </nova:ports>
Nov 24 10:24:15 user nova-compute[75073]:     </nova:instance>
Nov 24 10:24:15 user nova-compute[75073]:   </metadata>
Nov 24 10:24:15 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:24:15 user nova-compute[75073]:     <system>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="serial">78f066a7-6d92-4161-a720-0eb2ae5cea72</entry>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="uuid">78f066a7-6d92-4161-a720-0eb2ae5cea72</entry>
Nov 24 10:24:15 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:24:15 user nova-compute[75073]:     </system>
Nov 24 10:24:15 user nova-compute[75073]:   </sysinfo>
Nov 24 10:24:15 user nova-compute[75073]:   <os>
Nov 24 10:24:15 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:24:15 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:24:15 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:24:15 user nova-compute[75073]:   </os>
Nov 24 10:24:15 user nova-compute[75073]:   <features>
Nov 24 10:24:15 user nova-compute[75073]:     <acpi/>
Nov 24 10:24:15 user nova-compute[75073]:     <apic/>
Nov 24 10:24:15 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:24:15 user nova-compute[75073]:   </features>
Nov 24 10:24:15 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:24:15 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:24:15 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:24:15 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:24:15 user nova-compute[75073]:   </clock>
Nov 24 10:24:15 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:24:15 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:24:15 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:24:15 user nova-compute[75073]:   </cpu>
Nov 24 10:24:15 user nova-compute[75073]:   <devices>
Nov 24 10:24:15 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:24:15 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:24:15 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk"/>
Nov 24 10:24:15 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:24:15 user nova-compute[75073]:     </disk>
Nov 24 10:24:15 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:24:15 user nova-compute[75073]:       <mac address="fa:16:3e:81:9c:6d"/>
Nov 24 10:24:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:24:15 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:24:15 user nova-compute[75073]:       <target dev="tap0dd30b3c-f9"/>
Nov 24 10:24:15 user nova-compute[75073]:     </interface>
Nov 24 10:24:15 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:24:15 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/console.log" append="off"/>
Nov 24 10:24:15 user nova-compute[75073]:     </serial>
Nov 24 10:24:15 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:24:15 user nova-compute[75073]:     <video>
Nov 24 10:24:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:24:15 user nova-compute[75073]:     </video>
Nov 24 10:24:15 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:24:15 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:24:15 user nova-compute[75073]:     </rng>
Nov 24 10:24:15 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:24:15 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:24:15 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:24:15 user nova-compute[75073]:     </memballoon>
Nov 24 10:24:15 user nova-compute[75073]:   </devices>
Nov 24 10:24:15 user nova-compute[75073]: </domain>
Nov 24 10:24:15 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1855524810',display_name='tempest-VolumesAdminNegativeTest-server-1855524810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1855524810',id=11,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-z0ivi9c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:24:14Z,user_data=None,user_id='a09ba54648b745e6a09eed8514b7376a',uuid=78f066a7-6d92-4161-a720-0eb2ae5cea72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG os_vif [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '624ca391-bbfd-517b-98bc-231a0db2abe4', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dd30b3c-f9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dd30b3c-f9, col_values=(('qos', UUID('d23ac85a-e964-4d4b-aa48-5ba7fb1840b4')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dd30b3c-f9, col_values=(('external_ids', {'iface-id': '0dd30b3c-f96f-43fe-9d4f-6de8d5e771de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:9c:6d', 'vm-uuid': '78f066a7-6d92-4161-a720-0eb2ae5cea72'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:15 user nova-compute[75073]: INFO os_vif [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9')
Nov 24 10:24:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] No VIF found with MAC fa:16:3e:81:9c:6d, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lazy-loading 'flavor' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-46b44246-3fc4-4cca-aa4d-9329bcb4f17b tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Updated VIF entry in instance network info cache for port 0dd30b3c-f96f-43fe-9d4f-6de8d5e771de. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Updating instance_info_cache with network_info: [{"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6e128cf2-316c-472a-8ce7-0c250ac7fe55 req-49b25962-ef9e-4d47-9ae9-4808a50b1bfa service nova] Releasing lock "refresh_cache-78f066a7-6d92-4161-a720-0eb2ae5cea72" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] No waiting events found dispatching network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:17 user nova-compute[75073]: WARNING nova.compute.manager [req-ce6ea9d3-76e0-4c3e-97d0-ca0ca74a5b30 req-eb5e2566-5889-418a-a16e-db6d05b33d78 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received unexpected event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de for instance with vm_state building and task_state spawning.
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:24:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Instance spawned successfully.
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] No waiting events found dispatching network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:19 user nova-compute[75073]: WARNING nova.compute.manager [req-8eff843a-15bb-4591-85de-1b54935ece50 req-1e016387-6398-42dc-a1ea-d2dda4464dc5 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received unexpected event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de for instance with vm_state building and task_state spawning.
Nov 24 10:24:19 user nova-compute[75073]: INFO nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 24 10:24:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:24:19 user nova-compute[75073]: INFO nova.compute.manager [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Took 6.23 seconds to build instance.
Nov 24 10:24:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5ba34ebe-5da5-4c86-bf31-32fc6f59bac9 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-changed-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing instance network info cache due to event network-changed-166c07a2-a845-45af-9ab2-a802a1696e3f. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] Acquiring lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] Acquired lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:24:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Refreshing network info cache for port 166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:24:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updated VIF entry in instance network info cache for port 166c07a2-a845-45af-9ab2-a802a1696e3f. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:24:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7874180d-5924-42e8-a9cb-9a539f65b624 req-14b98966-5262-4718-9ede-d5024427ab33 service nova] Releasing lock "refresh_cache-8afebb27-fa78-48be-8750-a1d8141e10c9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:24 user nova-compute[75073]: INFO nova.compute.manager [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Terminating instance
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-82c09a57-a64f-41a4-a579-845632a51ab3 req-2cfe3830-9f70-4376-b7ca-5278c2d4e35d service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-26dabb9a-4c14-4982-ae42-8832cad5a681 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-14633b08-9f46-4b27-8b98-e4d5748d176e req-fcecb8c0-299c-4233-be41-82c13ea21744 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-166c07a2-a845-45af-9ab2-a802a1696e3f for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9872e29e-51d9-4e54-898b-1522f9bfb9a0 req-1d8c5243-fc40-47a6-af0c-2eeb0219714b service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-c5e20246-0a7b-4710-8630-fb065eda2084 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Instance destroyed successfully.
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lazy-loading 'resources' on Instance uuid 8afebb27-fa78-48be-8750-a1d8141e10c9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "166c07a2-a845-45af-9ab2-a802a1696e3f", "address": "fa:16:3e:97:07:4b", "network": {"id": "e1e004f7-927a-4341-84b4-a39b00c7aa0e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-264156932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166c07a2-a8", "ovs_interfaceid": "166c07a2-a845-45af-9ab2-a802a1696e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166c07a2-a8, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5c3115d-6aa5-4373-9338-d64580ccc16d) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:07:4b,bridge_name='br-int',has_traffic_filtering=True,id=166c07a2-a845-45af-9ab2-a802a1696e3f,network=Network(e1e004f7-927a-4341-84b4-a39b00c7aa0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166c07a2-a8')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dabb9a-4c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=078145e1-1489-48f3-9739-39fc5a5dae68) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:c5:37,bridge_name='br-int',has_traffic_filtering=True,id=26dabb9a-4c14-4982-ae42-8832cad5a681,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26dabb9a-4c')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcb05e47-1e, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f780209-5e1a-4472-9e93-f8da3d295d8d) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:d4,bridge_name='br-int',has_traffic_filtering=True,id=dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcb05e47-1e')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e20246-0a, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ab19c51-4b19-4b4a-a968-86ca53431a43) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:26 user nova-compute[75073]: WARNING nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-26dabb9a-4c14-4982-ae42-8832cad5a681 for instance with vm_state active and task_state deleting.
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-1377db28-8db1-41f1-a53c-01220dcc1163 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:26 user nova-compute[75073]: WARNING nova.compute.manager [req-101545bf-0f1c-45aa-9f12-1b41bcc88820 req-86ed1b6f-0300-4f05-8b44-7620ee596737 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-1377db28-8db1-41f1-a53c-01220dcc1163 for instance with vm_state active and task_state deleting.
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:5b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5e20246-0a7b-4710-8630-fb065eda2084,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e20246-0a')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86471a41-2e, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8690218d-a0d2-4993-8d77-2f2b46b7bf0a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:70:70,bridge_name='br-int',has_traffic_filtering=True,id=86471a41-2eb6-406f-a65e-c4f0d812c7d3,network=Network(a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86471a41-2e')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc03e45e2-66, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c4bd073-38a0-44b8-9a96-53457a541233) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c03e45e2-66db-49dc-a103-10aa73f45f16,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03e45e2-66')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-323054804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-323054804',id=9,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH83iCJG6zALtefI+h8Nkq9RKJuIQFsNB6zkZhuEPFMmx1Csqh+bbNkOXb+ee5cxjhzeoA1xlvZV4iBvnDES65/R+T3OsI/pRAXPRUjOfNiq4QNwDW1dQpRR4d6FWPJ6cQ==',key_name='tempest-keypair-968529398',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61bf1b653a4341c49a0b88456d6503e4',ramdisk_id='',reservation_id='r-2oy4wg0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263582714',owner_user_name='tempest-TaggedBootDevicesTest_v242-263582714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbfafdd56da3418e87eb3ba113d35f73',uuid=8afebb27-fa78-48be-8750-a1d8141e10c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converting VIF {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1377db28-8d, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0fd44cf-1fcb-44d7-b01c-e3b206e81b75) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:26 user nova-compute[75073]: INFO os_vif [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:38:4c,bridge_name='br-int',has_traffic_filtering=True,id=1377db28-8db1-41f1-a53c-01220dcc1163,network=Network(f0d15df9-5c21-4b2d-a545-bd62bfe2d54b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1377db28-8d')
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyzxmnBw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:24:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:26 user nova-compute[75073]: WARNING nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-166c07a2-a845-45af-9ab2-a802a1696e3f for instance with vm_state active and task_state deleting.
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING nova.compute.manager [req-c6efe1e7-6707-4095-a699-5fad806b67dd req-f15a941f-ad46-4d9a-ae6f-179b622ed38f service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89 for instance with vm_state active and task_state deleting.
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b21937-55ab-433a-aefc-82d87f599b8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: iSNS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: STATIC:
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: FIRMWARE:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:24:27 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d5bcdd-ebd3-47b7-a3db-96fbdfaec647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[969769aa-1aa9-42e7-8868-1ba79b73b142]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402693f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c'): ({'sdf'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Removing single pathed devices sdf {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.079s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79903867-c7f7-4b2e-a1d5-51df0c62eaa2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f9235e-29a4-4a07-9510-373380d4a1c8]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Flushing IO for device /dev/sdf {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c5e20246-0a7b-4710-8630-fb065eda2084 for instance with vm_state active and task_state deleting.
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-86471a41-2eb6-406f-a65e-c4f0d812c7d3 for instance with vm_state active and task_state deleting.
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-unplugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-unplugged-c03e45e2-66db-49dc-a103-10aa73f45f16 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Acquiring lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] No waiting events found dispatching network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING nova.compute.manager [req-56cfdd3a-b9d9-4774-8483-02e6198a9d7d req-120ba161-af9a-4224-b88a-818b856e2cb3 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received unexpected event network-vif-plugged-c03e45e2-66db-49dc-a103-10aa73f45f16 for instance with vm_state active and task_state deleting.
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[77320189-1213-4eca-bc94-5d584ba3f688]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf70db4-acf6-4b3f-9242-f7a38900aa03]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6223a7-d7c0-4f72-ba46-96fefa8045d6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d36ed-9b3f-4d71-92f5-037f239cd0f6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260]
Nov 24 10:24:27 user nova-compute[75073]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c, portal: 172.16.0.220,3260] successful.
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1228142-a389-48f1-9a9d-0c340407741c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f8744-8706-44c4-9cbb-0451a32ebbf0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.642s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== disconnect_volume: return (647ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgUwYcJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4649b7ee-43de-4d17-a379-b6c696080900]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: iSNS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: STATIC:
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: FIRMWARE:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:24:27 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e35946-70fa-429c-ae90-81bf0e724c0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6281febd-8220-4cfc-ac44-843bfd2fd291]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402693f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59'): ({'sdg'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Removing single pathed devices sdg {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9742f8-9a66-438d-b1f2-0c39cecea888]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37d4c4-de5d-4c43-8ce6-ed3726022ed2]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Flushing IO for device /dev/sdg {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176dc2f-d8c0-4b21-8369-6aa381843ab8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1669f2-f9ae-4a8c-9e47-395a4da05af4]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[721afe65-9aca-442d-9b90-fb65ca649073]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf4d695-aafe-4361-bc56-4a102ebb8657]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260]
Nov 24 10:24:27 user nova-compute[75073]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59, portal: 172.16.0.220,3260] successful.
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738ed1f1-ff40-4509-ac99-4880ae2abc59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace909b-fdc6-4bf8-82f7-bc2bc9cdd713]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== disconnect_volume: return (300ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFfzEsDy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:24:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12de47-2c7a-47ed-aa03-c252094bc889]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: iSNS:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]: STATIC:
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e
Nov 24 10:24:27 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:24:27 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:24:27 user nova-compute[75073]: FIRMWARE:
Nov 24 10:24:27 user nova-compute[75073]: No targets found.
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:24:27 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:24:27 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c6bc44-afa6-4873-b5ad-c48c3875b175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d39257-1dc1-4ed5-a7f9-d1f576284ea3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e (non-flash)
Nov 24 10:24:27 user nova-compute[75073]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:24:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402693f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e'): ({'sdh'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Removing single pathed devices sdh {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b2e255-aa4f-4a85-8c95-12a01cbe5f89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c2553-74ae-40f6-8e83-7831b89b3b62]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Flushing IO for device /dev/sdh {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7738718c-d861-413f-a054-552ddef8b65c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb65b703-29f3-4d2f-aa88-2d01b269a1f3]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] SCSI volumes sdh have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[affefafd-d284-454d-b0da-8380c76d1e83]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e121c08-d714-43de-8cd6-ed84a8f2accc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260]
Nov 24 10:24:28 user nova-compute[75073]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e, portal: 172.16.0.220,3260] successful.
Nov 24 10:24:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a422a4c-8099-4c6b-87d0-b97795726b1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d1eaf-ceb6-4802-8198-10b82517ac81]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] <== disconnect_volume: return (323ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:24:28 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Deleting instance files /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9_del
Nov 24 10:24:28 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Deletion of /opt/stack/data/nova/instances/8afebb27-fa78-48be-8750-a1d8141e10c9_del complete
Nov 24 10:24:28 user nova-compute[75073]: INFO nova.compute.manager [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Took 4.16 seconds to destroy the instance on the hypervisor.
Nov 24 10:24:28 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:24:28 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:29 user nova-compute[75073]: INFO nova.compute.manager [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Terminating instance
Nov 24 10:24:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-unplugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] No waiting events found dispatching network-vif-unplugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-f52060ef-3da6-44a4-bf59-b008cb7295ba req-7b95d9c9-11ed-4f5c-82c9-00fdd8fa92a0 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-unplugged-36c78c3f-e3c0-471c-b502-e3441b678fae for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Instance destroyed successfully.
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.objects.instance [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lazy-loading 'resources' on Instance uuid 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-909473074',display_name='tempest-VolumesAssistedSnapshotsTest-server-909473074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-909473074',id=8,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmXRI/Qjv9OCg3Z7qu22wnlwsfDf0Axoz9HA4u1gvwQwxP55PBhm1jhReQZC6L9EEoUq5kh30Mj77HMcy9oT7ZDdACOTd3HJlVHcsmSYEliEJV9YzH/IEpNt2fi2Y24VA==',key_name='tempest-keypair-371898589',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc1fc6e9e61a41139aeb14b05aade55b',ramdisk_id='',reservation_id='r-mfaqcu7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1321987503',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1321987503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3961e3742f41e698a259c3618b5881',uuid=9fe059bc-6c9e-4cb5-99d0-c96f28e287d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converting VIF {"id": "36c78c3f-e3c0-471c-b502-e3441b678fae", "address": "fa:16:3e:cb:1e:98", "network": {"id": "c55ad936-ff9c-4d31-86cc-2abf69b4737e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1351040736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc1fc6e9e61a41139aeb14b05aade55b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36c78c3f-e3", "ovs_interfaceid": "36c78c3f-e3c0-471c-b502-e3441b678fae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG os_vif [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36c78c3f-e3, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1417138-5dac-44df-9a1d-bc31bc4342d1) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:30 user nova-compute[75073]: INFO os_vif [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:1e:98,bridge_name='br-int',has_traffic_filtering=True,id=36c78c3f-e3c0-471c-b502-e3441b678fae,network=Network(c55ad936-ff9c-4d31-86cc-2abf69b4737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36c78c3f-e3')
Nov 24 10:24:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Deleting instance files /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8_del
Nov 24 10:24:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Deletion of /opt/stack/data/nova/instances/9fe059bc-6c9e-4cb5-99d0-c96f28e287d8_del complete
Nov 24 10:24:30 user nova-compute[75073]: INFO nova.compute.manager [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 24 10:24:30 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:24:30 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-e3408059-696b-489d-b4bc-d5ec3ee2cb22 req-c846f4bd-8f0e-4869-92b5-2a91cc276ae9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-deleted-166c07a2-a845-45af-9ab2-a802a1696e3f {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:31 user nova-compute[75073]: INFO nova.compute.manager [req-e3408059-696b-489d-b4bc-d5ec3ee2cb22 req-c846f4bd-8f0e-4869-92b5-2a91cc276ae9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Neutron deleted interface 166c07a2-a845-45af-9ab2-a802a1696e3f; detaching it from the instance and deleting it from the info cache
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.network.neutron [req-e3408059-696b-489d-b4bc-d5ec3ee2cb22 req-c846f4bd-8f0e-4869-92b5-2a91cc276ae9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [{"id": "26dabb9a-4c14-4982-ae42-8832cad5a681", "address": "fa:16:3e:ff:c5:37", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dabb9a-4c", "ovs_interfaceid": "26dabb9a-4c14-4982-ae42-8832cad5a681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "address": "fa:16:3e:04:c0:d4", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcb05e47-1e", "ovs_interfaceid": "dcb05e47-1ee7-4a89-8ba5-87b1ddcd6e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5e20246-0a7b-4710-8630-fb065eda2084", "address": "fa:16:3e:07:5b:3f", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e20246-0a", "ovs_interfaceid": "c5e20246-0a7b-4710-8630-fb065eda2084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "address": "fa:16:3e:53:70:70", "network": {"id": "a6b7fdc3-fb5b-42dc-aeca-c08cc02618d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1723264598", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86471a41-2e", "ovs_interfaceid": "86471a41-2eb6-406f-a65e-c4f0d812c7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c03e45e2-66db-49dc-a103-10aa73f45f16", "address": "fa:16:3e:1f:55:d5", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03e45e2-66", "ovs_interfaceid": "c03e45e2-66db-49dc-a103-10aa73f45f16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1377db28-8db1-41f1-a53c-01220dcc1163", "address": "fa:16:3e:a1:38:4c", "network": {"id": "f0d15df9-5c21-4b2d-a545-bd62bfe2d54b", "bridge": "br-int", "label": "tempest-device-tagging-net2-57517374", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "61bf1b653a4341c49a0b88456d6503e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1377db28-8d", "ovs_interfaceid": "1377db28-8db1-41f1-a53c-01220dcc1163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-e3408059-696b-489d-b4bc-d5ec3ee2cb22 req-c846f4bd-8f0e-4869-92b5-2a91cc276ae9 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Detach interface failed, port_id=166c07a2-a845-45af-9ab2-a802a1696e3f, reason: Instance 8afebb27-fa78-48be-8750-a1d8141e10c9 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] Acquiring lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] No waiting events found dispatching network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:31 user nova-compute[75073]: WARNING nova.compute.manager [req-839ae6ce-2366-4cf8-8bd5-000db7623606 req-0d89036f-d10a-43a9-a982-29ccd4dae9e6 service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received unexpected event network-vif-plugged-36c78c3f-e3c0-471c-b502-e3441b678fae for instance with vm_state active and task_state deleting.
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:31 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Took 1.44 seconds to deallocate network for instance.
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-7badea85-b2b4-4af5-b5c1-0693933fdb6a req-740e85ef-f8d2-412e-876c-77c6bfb5d3fa service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Received event network-vif-deleted-36c78c3f-e3c0-471c-b502-e3441b678fae {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:31 user nova-compute[75073]: INFO nova.compute.manager [req-7badea85-b2b4-4af5-b5c1-0693933fdb6a req-740e85ef-f8d2-412e-876c-77c6bfb5d3fa service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Neutron deleted interface 36c78c3f-e3c0-471c-b502-e3441b678fae; detaching it from the instance and deleting it from the info cache
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.network.neutron [req-7badea85-b2b4-4af5-b5c1-0693933fdb6a req-740e85ef-f8d2-412e-876c-77c6bfb5d3fa service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-7badea85-b2b4-4af5-b5c1-0693933fdb6a req-740e85ef-f8d2-412e-876c-77c6bfb5d3fa service nova] [instance: 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8] Detach interface failed, port_id=36c78c3f-e3c0-471c-b502-e3441b678fae, reason: Instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:32 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Deleted allocations for instance 9fe059bc-6c9e-4cb5-99d0-c96f28e287d8
Nov 24 10:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39cbb54b-bc06-4fce-b54c-2faf0bd9b53a tempest-VolumesAssistedSnapshotsTest-1321987503 tempest-VolumesAssistedSnapshotsTest-1321987503-project-member] Lock "9fe059bc-6c9e-4cb5-99d0-c96f28e287d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.209s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:32 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:32 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Took 4.69 seconds to deallocate network for instance.
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-92f72d3c-dfce-4e8b-9092-bd389909958f req-e02ec183-1891-43ca-ac60-5fd2bdfaf300 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-deleted-1377db28-8db1-41f1-a53c-01220dcc1163 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-92f72d3c-dfce-4e8b-9092-bd389909958f req-e02ec183-1891-43ca-ac60-5fd2bdfaf300 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-deleted-c03e45e2-66db-49dc-a103-10aa73f45f16 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-92f72d3c-dfce-4e8b-9092-bd389909958f req-e02ec183-1891-43ca-ac60-5fd2bdfaf300 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-deleted-c5e20246-0a7b-4710-8630-fb065eda2084 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-92f72d3c-dfce-4e8b-9092-bd389909958f req-e02ec183-1891-43ca-ac60-5fd2bdfaf300 service nova] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Received event network-vif-deleted-86471a41-2eb6-406f-a65e-c4f0d812c7d3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:24:33 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:24:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating instance_info_cache with network_info: [{"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-fb7cefcf-9df1-4174-b68c-addb1af850a0" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:24:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:24:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:35 user nova-compute[75073]: INFO nova.compute.manager [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] [instance: 8afebb27-fa78-48be-8750-a1d8141e10c9] Took 2.63 seconds to detach 3 volumes for instance.
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:35 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.250s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:24:36 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Deleted allocations for instance 8afebb27-fa78-48be-8750-a1d8141e10c9
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5bad65ad-a272-4cbd-bf8e-5d7236f83db0 tempest-TaggedBootDevicesTest_v242-263582714 tempest-TaggedBootDevicesTest_v242-263582714-project-member] Lock "8afebb27-fa78-48be-8750-a1d8141e10c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.088s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:24:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:24:39 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=25.628650665283203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fb7cefcf-9df1-4174-b68c-addb1af850a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 78f066a7-6d92-4161-a720-0eb2ae5cea72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:24:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:24:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:42 user nova-compute[75073]: INFO nova.compute.manager [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Terminating instance
Nov 24 10:24:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-unplugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-unplugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-9f799d8b-ca0f-416d-a96f-5de25afba763 req-675f458b-0793-4931-bf56-9a7e8d078653 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-unplugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Instance destroyed successfully.
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lazy-loading 'resources' on Instance uuid b745dbf9-0dc2-4d1a-b709-d48422e9a537 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1772667118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1772667118',id=6,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2rI82J4QzIQA2+4zu/2Vyn469W+dvwhWk9uomjKWwFS4d7NhYYXK/6JBIdFszFJWpwVzdP0gkoonf7qvfE7E+3jGzaJjf4yXsyuoMNuMd44ZM26Ec4QQWxVFhsA2Mf4Q==',key_name='tempest-keypair-1443733478',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdeb11f3d47f45c7a467c206134af82f',ramdisk_id='',reservation_id='r-c5glofpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-846416394',owner_user_name='tempest-TaggedAttachmentsTest-846416394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb6e6c16c4c4638a91632bee60f3bd1',uuid=b745dbf9-0dc2-4d1a-b709-d48422e9a537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converting VIF {"id": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "address": "fa:16:3e:74:6e:7f", "network": {"id": "e8e2295c-4586-478c-8e8d-866b6683d76f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-921512352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdeb11f3d47f45c7a467c206134af82f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec1d3f24-31", "ovs_interfaceid": "ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG os_vif [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec1d3f24-31, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98813223-d3c2-4e66-996a-608b859e5a3f) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:43 user nova-compute[75073]: INFO os_vif [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:6e:7f,bridge_name='br-int',has_traffic_filtering=True,id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c,network=Network(e8e2295c-4586-478c-8e8d-866b6683d76f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec1d3f24-31')
Nov 24 10:24:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Deleting instance files /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537_del
Nov 24 10:24:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Deletion of /opt/stack/data/nova/instances/b745dbf9-0dc2-4d1a-b709-d48422e9a537_del complete
Nov 24 10:24:43 user nova-compute[75073]: INFO nova.compute.manager [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 24 10:24:43 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:24:43 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:44 user nova-compute[75073]: INFO nova.compute.manager [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Terminating instance
Nov 24 10:24:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-685a5325-4f18-4f6f-a053-eec7890235bd req-577c6a0a-bee1-4f2a-9b41-12c6d43d792f service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-deleted-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:44 user nova-compute[75073]: INFO nova.compute.manager [req-685a5325-4f18-4f6f-a053-eec7890235bd req-577c6a0a-bee1-4f2a-9b41-12c6d43d792f service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Neutron deleted interface ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c; detaching it from the instance and deleting it from the info cache
Nov 24 10:24:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-685a5325-4f18-4f6f-a053-eec7890235bd req-577c6a0a-bee1-4f2a-9b41-12c6d43d792f service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:44 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Took 1.40 seconds to deallocate network for instance.
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-685a5325-4f18-4f6f-a053-eec7890235bd req-577c6a0a-bee1-4f2a-9b41-12c6d43d792f service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Detach interface failed, port_id=ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c, reason: Instance b745dbf9-0dc2-4d1a-b709-d48422e9a537 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Acquiring lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] No waiting events found dispatching network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:45 user nova-compute[75073]: WARNING nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: b745dbf9-0dc2-4d1a-b709-d48422e9a537] Received unexpected event network-vif-plugged-ec1d3f24-31fa-4262-a3e3-2a9bc6666f7c for instance with vm_state active and task_state deleting.
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-5db86029-c3c8-46be-a42e-aa77ecabea86 req-e3803f3e-cd02-47b8-ac51-ef8cb4f0feb8 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Instance destroyed successfully.
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.objects.instance [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lazy-loading 'resources' on Instance uuid fb7cefcf-9df1-4174-b68c-addb1af850a0 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1533894683',display_name='tempest-TestVolumeSwap-server-1533894683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1533894683',id=4,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHB9bExe2petiiqkKBav8TiRhRW29ynlEsPGqTPmSV5psGbsbBC55eiLY8wtSPy9x+PF9358qh0jK1waaIbS8SKalf0rA28fTwZKKqqC6NVP38WXf63Rr11RTgexiwx/w==',key_name='tempest-keypair-278561638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1d9ba5f495d45e183eb356e1d5313f6',ramdisk_id='',reservation_id='r-is53q39i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-810790799',owner_user_name='tempest-TestVolumeSwap-810790799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3d4968c7254d35b546543de4205ae9',uuid=fb7cefcf-9df1-4174-b68c-addb1af850a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converting VIF {"id": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "address": "fa:16:3e:94:60:6b", "network": {"id": "06cd8aa1-081e-46e6-998a-1e7f5e9005a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1757033337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1d9ba5f495d45e183eb356e1d5313f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap748ee9e7-1f", "ovs_interfaceid": "748ee9e7-1f70-41a7-9e50-fb8e09a501ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG os_vif [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap748ee9e7-1f, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e2e2388-6b6a-4444-957b-a409c728640a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:24:45 user nova-compute[75073]: INFO os_vif [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:60:6b,bridge_name='br-int',has_traffic_filtering=True,id=748ee9e7-1f70-41a7-9e50-fb8e09a501ff,network=Network(06cd8aa1-081e-46e6-998a-1e7f5e9005a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap748ee9e7-1f')
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Deleting instance files /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0_del
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Deletion of /opt/stack/data/nova/instances/fb7cefcf-9df1-4174-b68c-addb1af850a0_del complete
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Deleted allocations for instance b745dbf9-0dc2-4d1a-b709-d48422e9a537
Nov 24 10:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:45 user nova-compute[75073]: INFO nova.compute.manager [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:24:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8f6ec423-289d-4cd6-9384-7ba293370d5d tempest-TaggedAttachmentsTest-846416394 tempest-TaggedAttachmentsTest-846416394-project-member] Lock "b745dbf9-0dc2-4d1a-b709-d48422e9a537" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:46 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:24:47 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Took 1.42 seconds to deallocate network for instance.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-ac084de1-72de-405d-bd3a-920c8db288b3 req-103da3cd-06e3-48ca-86bb-212bb00c831e service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-deleted-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:47 user nova-compute[75073]: WARNING nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state deleted and task_state None.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:47 user nova-compute[75073]: WARNING nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state deleted and task_state None.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:47 user nova-compute[75073]: WARNING nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state deleted and task_state None.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:47 user nova-compute[75073]: WARNING nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-unplugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state deleted and task_state None.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Acquiring lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] No waiting events found dispatching network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:24:47 user nova-compute[75073]: WARNING nova.compute.manager [req-b553ad0c-4d03-4d96-a450-74700076f2b4 req-86f38409-029c-42e8-8c31-1ad2241ee6a5 service nova] [instance: fb7cefcf-9df1-4174-b68c-addb1af850a0] Received unexpected event network-vif-plugged-748ee9e7-1f70-41a7-9e50-fb8e09a501ff for instance with vm_state deleted and task_state None.
Nov 24 10:24:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:47 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Deleted allocations for instance fb7cefcf-9df1-4174-b68c-addb1af850a0
Nov 24 10:24:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-15bf5764-f9a6-4eff-a9aa-cf98222476f9 tempest-TestVolumeSwap-810790799 tempest-TestVolumeSwap-810790799-project-member] Lock "fb7cefcf-9df1-4174-b68c-addb1af850a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:24:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:24:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:25:01 user nova-compute[75073]: INFO nova.compute.claims [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Claim successful on node user
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:25:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:25:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:25:01 user nova-compute[75073]: DEBUG nova.policy [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed52b6310e348f180cb2fb8505eb57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21897c36caac4b01a9f42f336570b19d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:25:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Creating image(s)
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "/opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "/opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "/opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk 1073741824" returned: 0 in 0.053s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Successfully created port: 6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Cannot resize image /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Ensure instance console log exists: /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Successfully updated port: 6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquired lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-changed-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Refreshing instance network info cache due to event network-changed-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] Acquiring lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Updating instance_info_cache with network_info: [{"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Releasing lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Instance network_info: |[{"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] Acquired lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Refreshing network info cache for port 6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Start _get_guest_xml network_info=[{"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:25:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-461550238',display_name='tempest-DeleteServersTestJSON-server-461550238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-461550238',id=12,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21897c36caac4b01a9f42f336570b19d',ramdisk_id='',reservation_id='r-8dgj9wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1843289919',owner_user_name='tempest-DeleteServersTestJSON-1843289919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:02Z,user_data=None,user_id='7ed52b6310e348f180cb2fb8505eb57e',uuid=9097c72a-e947-44ec-8e2e-8ba4c025adb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converting VIF {"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lazy-loading 'pci_devices' on Instance uuid 9097c72a-e947-44ec-8e2e-8ba4c025adb5 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:25:03 user nova-compute[75073]:   <uuid>9097c72a-e947-44ec-8e2e-8ba4c025adb5</uuid>
Nov 24 10:25:03 user nova-compute[75073]:   <name>instance-0000000c</name>
Nov 24 10:25:03 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:25:03 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:25:03 user nova-compute[75073]:   <metadata>
Nov 24 10:25:03 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:25:03 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:name>tempest-DeleteServersTestJSON-server-461550238</nova:name>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:25:03</nova:creationTime>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:25:03 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:25:03 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:owner>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:user uuid="7ed52b6310e348f180cb2fb8505eb57e">tempest-DeleteServersTestJSON-1843289919-project-member</nova:user>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:project uuid="21897c36caac4b01a9f42f336570b19d">tempest-DeleteServersTestJSON-1843289919</nova:project>
Nov 24 10:25:03 user nova-compute[75073]:       </nova:owner>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:25:03 user nova-compute[75073]:       <nova:ports>
Nov 24 10:25:03 user nova-compute[75073]:         <nova:port uuid="6ee865cc-e9b8-447a-a856-2a6b1d2de6f6">
Nov 24 10:25:03 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:25:03 user nova-compute[75073]:         </nova:port>
Nov 24 10:25:03 user nova-compute[75073]:       </nova:ports>
Nov 24 10:25:03 user nova-compute[75073]:     </nova:instance>
Nov 24 10:25:03 user nova-compute[75073]:   </metadata>
Nov 24 10:25:03 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:25:03 user nova-compute[75073]:     <system>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="serial">9097c72a-e947-44ec-8e2e-8ba4c025adb5</entry>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="uuid">9097c72a-e947-44ec-8e2e-8ba4c025adb5</entry>
Nov 24 10:25:03 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:25:03 user nova-compute[75073]:     </system>
Nov 24 10:25:03 user nova-compute[75073]:   </sysinfo>
Nov 24 10:25:03 user nova-compute[75073]:   <os>
Nov 24 10:25:03 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:25:03 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:25:03 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:25:03 user nova-compute[75073]:   </os>
Nov 24 10:25:03 user nova-compute[75073]:   <features>
Nov 24 10:25:03 user nova-compute[75073]:     <acpi/>
Nov 24 10:25:03 user nova-compute[75073]:     <apic/>
Nov 24 10:25:03 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:25:03 user nova-compute[75073]:   </features>
Nov 24 10:25:03 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:25:03 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:25:03 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:25:03 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:25:03 user nova-compute[75073]:   </clock>
Nov 24 10:25:03 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:25:03 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:25:03 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:25:03 user nova-compute[75073]:   </cpu>
Nov 24 10:25:03 user nova-compute[75073]:   <devices>
Nov 24 10:25:03 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:03 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:03 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk"/>
Nov 24 10:25:03 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:25:03 user nova-compute[75073]:     </disk>
Nov 24 10:25:03 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:25:03 user nova-compute[75073]:       <mac address="fa:16:3e:ed:70:4b"/>
Nov 24 10:25:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:03 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:25:03 user nova-compute[75073]:       <target dev="tap6ee865cc-e9"/>
Nov 24 10:25:03 user nova-compute[75073]:     </interface>
Nov 24 10:25:03 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:25:03 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/console.log" append="off"/>
Nov 24 10:25:03 user nova-compute[75073]:     </serial>
Nov 24 10:25:03 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:25:03 user nova-compute[75073]:     <video>
Nov 24 10:25:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:03 user nova-compute[75073]:     </video>
Nov 24 10:25:03 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:25:03 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:25:03 user nova-compute[75073]:     </rng>
Nov 24 10:25:03 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:25:03 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:25:03 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:25:03 user nova-compute[75073]:     </memballoon>
Nov 24 10:25:03 user nova-compute[75073]:   </devices>
Nov 24 10:25:03 user nova-compute[75073]: </domain>
Nov 24 10:25:03 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-461550238',display_name='tempest-DeleteServersTestJSON-server-461550238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-461550238',id=12,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21897c36caac4b01a9f42f336570b19d',ramdisk_id='',reservation_id='r-8dgj9wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1843289919',owner_user_name='tempest-DeleteServersTestJSON-1843289919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:02Z,user_data=None,user_id='7ed52b6310e348f180cb2fb8505eb57e',uuid=9097c72a-e947-44ec-8e2e-8ba4c025adb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converting VIF {"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG os_vif [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c130d641-15ca-5681-bca0-6ae0383d1b4e', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ee865cc-e9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ee865cc-e9, col_values=(('qos', UUID('a095dbc0-b09a-425c-9bd5-d3b6e1437781')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ee865cc-e9, col_values=(('external_ids', {'iface-id': '6ee865cc-e9b8-447a-a856-2a6b1d2de6f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:70:4b', 'vm-uuid': '9097c72a-e947-44ec-8e2e-8ba4c025adb5'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:04 user nova-compute[75073]: INFO os_vif [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9')
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] No VIF found with MAC fa:16:3e:ed:70:4b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Updated VIF entry in instance network info cache for port 6ee865cc-e9b8-447a-a856-2a6b1d2de6f6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Updating instance_info_cache with network_info: [{"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c44b4a9-56df-44f1-9281-70051f888816 req-ed367867-8af9-4881-94da-784f2e7e41d8 service nova] Releasing lock "refresh_cache-9097c72a-e947-44ec-8e2e-8ba4c025adb5" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:25:05 user nova-compute[75073]: INFO nova.compute.claims [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Claim successful on node user
Nov 24 10:25:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:25:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.policy [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dffd5f6353e344aa96a97235372632fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4665d407280c4667beadb1678e105480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] No waiting events found dispatching network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:05 user nova-compute[75073]: WARNING nova.compute.manager [req-f7d51ce7-b097-4d65-98e8-8aab11195084 req-8d82b286-f00c-4365-a188-5159ccb478f9 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received unexpected event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 for instance with vm_state building and task_state spawning.
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:25:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Creating image(s)
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "/opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk 1073741824" returned: 0 in 0.048s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Successfully created port: 270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Cannot resize image /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Ensure instance console log exists: /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Successfully updated port: 270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:25:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Instance network_info: |[{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Start _get_guest_xml network_info=[{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:25:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1983557742',display_name='tempest-ServerActionsTestOtherA-server-1983557742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1983557742',id=13,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-tmwv1x0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=06ed6f5a-958b-4414-9dbd-69641b193367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'pci_devices' on Instance uuid 06ed6f5a-958b-4414-9dbd-69641b193367 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:25:07 user nova-compute[75073]:   <uuid>06ed6f5a-958b-4414-9dbd-69641b193367</uuid>
Nov 24 10:25:07 user nova-compute[75073]:   <name>instance-0000000d</name>
Nov 24 10:25:07 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:25:07 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:25:07 user nova-compute[75073]:   <metadata>
Nov 24 10:25:07 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:25:07 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherA-server-1983557742</nova:name>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:25:07</nova:creationTime>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:25:07 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:25:07 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:owner>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:user uuid="dffd5f6353e344aa96a97235372632fd">tempest-ServerActionsTestOtherA-371935856-project-member</nova:user>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:project uuid="4665d407280c4667beadb1678e105480">tempest-ServerActionsTestOtherA-371935856</nova:project>
Nov 24 10:25:07 user nova-compute[75073]:       </nova:owner>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:25:07 user nova-compute[75073]:       <nova:ports>
Nov 24 10:25:07 user nova-compute[75073]:         <nova:port uuid="270f3e17-8211-4cd8-b238-50bcf82dc6f1">
Nov 24 10:25:07 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:25:07 user nova-compute[75073]:         </nova:port>
Nov 24 10:25:07 user nova-compute[75073]:       </nova:ports>
Nov 24 10:25:07 user nova-compute[75073]:     </nova:instance>
Nov 24 10:25:07 user nova-compute[75073]:   </metadata>
Nov 24 10:25:07 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:25:07 user nova-compute[75073]:     <system>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="serial">06ed6f5a-958b-4414-9dbd-69641b193367</entry>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="uuid">06ed6f5a-958b-4414-9dbd-69641b193367</entry>
Nov 24 10:25:07 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:25:07 user nova-compute[75073]:     </system>
Nov 24 10:25:07 user nova-compute[75073]:   </sysinfo>
Nov 24 10:25:07 user nova-compute[75073]:   <os>
Nov 24 10:25:07 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:25:07 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:25:07 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:25:07 user nova-compute[75073]:   </os>
Nov 24 10:25:07 user nova-compute[75073]:   <features>
Nov 24 10:25:07 user nova-compute[75073]:     <acpi/>
Nov 24 10:25:07 user nova-compute[75073]:     <apic/>
Nov 24 10:25:07 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:25:07 user nova-compute[75073]:   </features>
Nov 24 10:25:07 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:25:07 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:25:07 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:25:07 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:25:07 user nova-compute[75073]:   </clock>
Nov 24 10:25:07 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:25:07 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:25:07 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:25:07 user nova-compute[75073]:   </cpu>
Nov 24 10:25:07 user nova-compute[75073]:   <devices>
Nov 24 10:25:07 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:07 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:07 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk"/>
Nov 24 10:25:07 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:25:07 user nova-compute[75073]:     </disk>
Nov 24 10:25:07 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:25:07 user nova-compute[75073]:       <mac address="fa:16:3e:2c:d2:00"/>
Nov 24 10:25:07 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:07 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:25:07 user nova-compute[75073]:       <target dev="tap270f3e17-82"/>
Nov 24 10:25:07 user nova-compute[75073]:     </interface>
Nov 24 10:25:07 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:25:07 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/console.log" append="off"/>
Nov 24 10:25:07 user nova-compute[75073]:     </serial>
Nov 24 10:25:07 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:25:07 user nova-compute[75073]:     <video>
Nov 24 10:25:07 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:07 user nova-compute[75073]:     </video>
Nov 24 10:25:07 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:25:07 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:25:07 user nova-compute[75073]:     </rng>
Nov 24 10:25:07 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:25:07 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:25:07 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:25:07 user nova-compute[75073]:     </memballoon>
Nov 24 10:25:07 user nova-compute[75073]:   </devices>
Nov 24 10:25:07 user nova-compute[75073]: </domain>
Nov 24 10:25:07 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1983557742',display_name='tempest-ServerActionsTestOtherA-server-1983557742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1983557742',id=13,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-tmwv1x0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=06ed6f5a-958b-4414-9dbd-69641b193367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG os_vif [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '315199a4-fc08-57a7-b6d0-b0eb089166d6', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap270f3e17-82, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap270f3e17-82, col_values=(('qos', UUID('a6f559de-604c-4f65-b77c-0491b4161f53')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap270f3e17-82, col_values=(('external_ids', {'iface-id': '270f3e17-8211-4cd8-b238-50bcf82dc6f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:d2:00', 'vm-uuid': '06ed6f5a-958b-4414-9dbd-69641b193367'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:07 user nova-compute[75073]: INFO os_vif [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82')
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:2c:d2:00, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:25:07 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Instance spawned successfully.
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:07 user nova-compute[75073]: INFO nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] No waiting events found dispatching network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:07 user nova-compute[75073]: WARNING nova.compute.manager [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received unexpected event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 for instance with vm_state building and task_state spawning.
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing instance network info cache due to event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:25:07 user nova-compute[75073]: INFO nova.compute.manager [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Took 6.39 seconds to build instance.
Nov 24 10:25:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f111bbdf-fd98-48d9-b4cc-94cca094d200 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.488s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated VIF entry in instance network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad95ca2-41f1-4626-8f21-5e4635d44c37 req-8f45ee27-a2fd-4075-83f4-2144cb180829 service nova] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] No waiting events found dispatching network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:09 user nova-compute[75073]: WARNING nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received unexpected event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 for instance with vm_state building and task_state spawning.
Nov 24 10:25:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] No waiting events found dispatching network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:09 user nova-compute[75073]: WARNING nova.compute.manager [req-7922c3e8-94aa-4b71-b27d-9f947ca5594e req-1a63aca6-c37c-4a48-a039-2820503ea131 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received unexpected event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 for instance with vm_state building and task_state spawning.
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:25:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Instance spawned successfully.
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:11 user nova-compute[75073]: INFO nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 24 10:25:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:25:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:11 user nova-compute[75073]: INFO nova.compute.manager [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Took 6.36 seconds to build instance.
Nov 24 10:25:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85bc4209-839f-4461-979d-97a4e7bec616 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.454s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:25:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:30 user nova-compute[75073]: INFO nova.compute.manager [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Rescuing
Nov 24 10:25:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:30 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:31 user nova-compute[75073]: WARNING nova.compute.manager [req-33219c82-24c9-415e-8363-f6dbfe67f59c req-b6e69251-b473-4d02-94ed-daa7fa03d501 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state rescuing.
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance destroyed successfully.
Nov 24 10:25:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Attempting rescue
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:25:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Creating image(s)
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.223s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue" returned: 0 in 0.054s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'migration_context' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<368baad5-b756-4ae5-aa18-9d148632523d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start _get_guest_xml network_info=[{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:23:11:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<368baad5-b756-4ae5-aa18-9d148632523d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'numa_topology' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<368baad5-b756-4ae5-aa18-9d148632523d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:25:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<368baad5-b756-4ae5-aa18-9d148632523d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1200068686',display_name='tempest-ServerRescueNegativeTestJSON-server-1200068686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1200068686',id=1,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-dap0tq8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:21:01Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=368baad5-b756-4ae5-aa18-9d148632523d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:23:11:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:23:11:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<368baad5-b756-4ae5-aa18-9d148632523d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:25:32 user nova-compute[75073]:   <uuid>368baad5-b756-4ae5-aa18-9d148632523d</uuid>
Nov 24 10:25:32 user nova-compute[75073]:   <name>instance-00000001</name>
Nov 24 10:25:32 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:25:32 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:25:32 user nova-compute[75073]:   <metadata>
Nov 24 10:25:32 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:25:32 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1200068686</nova:name>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:25:32</nova:creationTime>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:25:32 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:25:32 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:owner>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:25:32 user nova-compute[75073]:       </nova:owner>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:25:32 user nova-compute[75073]:       <nova:ports>
Nov 24 10:25:32 user nova-compute[75073]:         <nova:port uuid="86f2db00-09e3-4054-a321-99883e964598">
Nov 24 10:25:32 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:25:32 user nova-compute[75073]:         </nova:port>
Nov 24 10:25:32 user nova-compute[75073]:       </nova:ports>
Nov 24 10:25:32 user nova-compute[75073]:     </nova:instance>
Nov 24 10:25:32 user nova-compute[75073]:   </metadata>
Nov 24 10:25:32 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:25:32 user nova-compute[75073]:     <system>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="serial">368baad5-b756-4ae5-aa18-9d148632523d</entry>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="uuid">368baad5-b756-4ae5-aa18-9d148632523d</entry>
Nov 24 10:25:32 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:25:32 user nova-compute[75073]:     </system>
Nov 24 10:25:32 user nova-compute[75073]:   </sysinfo>
Nov 24 10:25:32 user nova-compute[75073]:   <os>
Nov 24 10:25:32 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:25:32 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:25:32 user nova-compute[75073]:   </os>
Nov 24 10:25:32 user nova-compute[75073]:   <features>
Nov 24 10:25:32 user nova-compute[75073]:     <acpi/>
Nov 24 10:25:32 user nova-compute[75073]:     <apic/>
Nov 24 10:25:32 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:25:32 user nova-compute[75073]:   </features>
Nov 24 10:25:32 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:25:32 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:25:32 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:25:32 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:25:32 user nova-compute[75073]:   </clock>
Nov 24 10:25:32 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:25:32 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:25:32 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:25:32 user nova-compute[75073]:   </cpu>
Nov 24 10:25:32 user nova-compute[75073]:   <devices>
Nov 24 10:25:32 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:32 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:32 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue"/>
Nov 24 10:25:32 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:25:32 user nova-compute[75073]:     </disk>
Nov 24 10:25:32 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:32 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:32 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk"/>
Nov 24 10:25:32 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:25:32 user nova-compute[75073]:     </disk>
Nov 24 10:25:32 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:25:32 user nova-compute[75073]:       <mac address="fa:16:3e:23:11:5a"/>
Nov 24 10:25:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:32 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:25:32 user nova-compute[75073]:       <target dev="tap86f2db00-09"/>
Nov 24 10:25:32 user nova-compute[75073]:     </interface>
Nov 24 10:25:32 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:25:32 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/console.log" append="off"/>
Nov 24 10:25:32 user nova-compute[75073]:     </serial>
Nov 24 10:25:32 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:25:32 user nova-compute[75073]:     <video>
Nov 24 10:25:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:32 user nova-compute[75073]:     </video>
Nov 24 10:25:32 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:25:32 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:25:32 user nova-compute[75073]:     </rng>
Nov 24 10:25:32 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:25:32 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:25:32 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:25:32 user nova-compute[75073]:     </memballoon>
Nov 24 10:25:32 user nova-compute[75073]:   </devices>
Nov 24 10:25:32 user nova-compute[75073]: </domain>
Nov 24 10:25:32 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:25:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance destroyed successfully.
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:23:11:5a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:33 user nova-compute[75073]: WARNING nova.compute.manager [req-fed9cd97-81fa-4d36-b571-912343f3ce90 req-edd7288e-1e88-4f57-904d-40d608cd0fe0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state rescuing.
Nov 24 10:25:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:35 user nova-compute[75073]: WARNING nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state rescuing.
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:35 user nova-compute[75073]: WARNING nova.compute.manager [req-4e1c6f91-a23f-44af-855b-f1df2ee610c3 req-42a94997-79bb-4e36-988a-32d14ed2f86c service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state rescuing.
Nov 24 10:25:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8175d4bb-770b-4d84-b4e6-032a87dacde9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:25:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=25.64305877685547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 78f066a7-6d92-4161-a720-0eb2ae5cea72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 9097c72a-e947-44ec-8e2e-8ba4c025adb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.354s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:25:42 user nova-compute[75073]: INFO nova.compute.claims [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Claim successful on node user
Nov 24 10:25:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:25:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.policy [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c5754304104fec9f1af3afc52e6f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99debe1b1a2443eba2f955911465f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:25:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Creating image(s)
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "/opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.213s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.214s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk 1073741824" returned: 0 in 0.067s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.294s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Cannot resize image /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Ensure instance console log exists: /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Successfully created port: a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Successfully updated port: a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-changed-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Refreshing instance network info cache due to event network-changed-a4190797-2074-4344-b674-c772d33d7565. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Instance network_info: |[{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.neutron [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Refreshing network info cache for port a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Start _get_guest_xml network_info=[{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:25:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1932737607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1932737607',id=14,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-c1q9r6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:43Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=5945a479-75dc-4018-a7cd-80c5ab25b67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid 5945a479-75dc-4018-a7cd-80c5ab25b67c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:25:46 user nova-compute[75073]:   <uuid>5945a479-75dc-4018-a7cd-80c5ab25b67c</uuid>
Nov 24 10:25:46 user nova-compute[75073]:   <name>instance-0000000e</name>
Nov 24 10:25:46 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:25:46 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:25:46 user nova-compute[75073]:   <metadata>
Nov 24 10:25:46 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:25:46 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1932737607</nova:name>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:25:46</nova:creationTime>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:25:46 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:25:46 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:owner>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:25:46 user nova-compute[75073]:       </nova:owner>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:25:46 user nova-compute[75073]:       <nova:ports>
Nov 24 10:25:46 user nova-compute[75073]:         <nova:port uuid="a4190797-2074-4344-b674-c772d33d7565">
Nov 24 10:25:46 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:25:46 user nova-compute[75073]:         </nova:port>
Nov 24 10:25:46 user nova-compute[75073]:       </nova:ports>
Nov 24 10:25:46 user nova-compute[75073]:     </nova:instance>
Nov 24 10:25:46 user nova-compute[75073]:   </metadata>
Nov 24 10:25:46 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:25:46 user nova-compute[75073]:     <system>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="serial">5945a479-75dc-4018-a7cd-80c5ab25b67c</entry>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="uuid">5945a479-75dc-4018-a7cd-80c5ab25b67c</entry>
Nov 24 10:25:46 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:25:46 user nova-compute[75073]:     </system>
Nov 24 10:25:46 user nova-compute[75073]:   </sysinfo>
Nov 24 10:25:46 user nova-compute[75073]:   <os>
Nov 24 10:25:46 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:25:46 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:25:46 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:25:46 user nova-compute[75073]:   </os>
Nov 24 10:25:46 user nova-compute[75073]:   <features>
Nov 24 10:25:46 user nova-compute[75073]:     <acpi/>
Nov 24 10:25:46 user nova-compute[75073]:     <apic/>
Nov 24 10:25:46 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:25:46 user nova-compute[75073]:   </features>
Nov 24 10:25:46 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:25:46 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:25:46 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:25:46 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:25:46 user nova-compute[75073]:   </clock>
Nov 24 10:25:46 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:25:46 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:25:46 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:25:46 user nova-compute[75073]:   </cpu>
Nov 24 10:25:46 user nova-compute[75073]:   <devices>
Nov 24 10:25:46 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:46 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:46 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk"/>
Nov 24 10:25:46 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:25:46 user nova-compute[75073]:     </disk>
Nov 24 10:25:46 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:25:46 user nova-compute[75073]:       <mac address="fa:16:3e:43:19:9a"/>
Nov 24 10:25:46 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:46 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:25:46 user nova-compute[75073]:       <target dev="tapa4190797-20"/>
Nov 24 10:25:46 user nova-compute[75073]:     </interface>
Nov 24 10:25:46 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:25:46 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/console.log" append="off"/>
Nov 24 10:25:46 user nova-compute[75073]:     </serial>
Nov 24 10:25:46 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:25:46 user nova-compute[75073]:     <video>
Nov 24 10:25:46 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:46 user nova-compute[75073]:     </video>
Nov 24 10:25:46 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:25:46 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:25:46 user nova-compute[75073]:     </rng>
Nov 24 10:25:46 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:25:46 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:25:46 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:25:46 user nova-compute[75073]:     </memballoon>
Nov 24 10:25:46 user nova-compute[75073]:   </devices>
Nov 24 10:25:46 user nova-compute[75073]: </domain>
Nov 24 10:25:46 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1932737607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1932737607',id=14,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-c1q9r6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:43Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=5945a479-75dc-4018-a7cd-80c5ab25b67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG os_vif [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fd2f041-b20d-59ce-bf70-ba53fce1dcd3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4190797-20, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4190797-20, col_values=(('qos', UUID('2961f486-0b55-4215-9e8e-39eabedb8464')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4190797-20, col_values=(('external_ids', {'iface-id': 'a4190797-2074-4344-b674-c772d33d7565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:19:9a', 'vm-uuid': '5945a479-75dc-4018-a7cd-80c5ab25b67c'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:46 user nova-compute[75073]: INFO os_vif [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20')
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:43:19:9a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.neutron [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updated VIF entry in instance network info cache for port a4190797-2074-4344-b674-c772d33d7565. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG nova.network.neutron [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9dd0e70-2923-4188-a2d6-7a708b7df9af req-246198a9-a728-4fb2-8de0-a1481944525d service nova] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:25:49 user nova-compute[75073]: INFO nova.compute.claims [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Claim successful on node user
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Instance spawned successfully.
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:25:50 user nova-compute[75073]: INFO nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:25:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:25:50 user nova-compute[75073]: INFO nova.compute.manager [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Took 8.49 seconds to build instance.
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3af47a70-85ec-4ddc-98eb-e0092d8333a5 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.717s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.policy [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42d05b01c17a48aa93bcd7a4078332d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496d4b08c8784b6b8afeb105d7fef10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:25:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Creating image(s)
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] No waiting events found dispatching network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:51 user nova-compute[75073]: WARNING nova.compute.manager [req-4d9c8f63-6e9b-406a-a64b-e2948e692e08 req-9aeca8c4-798f-46cf-a40a-412dec206c6c service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received unexpected event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 for instance with vm_state active and task_state None.
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.240s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk 1073741824" returned: 0 in 0.077s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Cannot resize image /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Ensure instance console log exists: /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Successfully created port: 2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Successfully updated port: 2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-changed-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Refreshing instance network info cache due to event network-changed-2345385d-d91c-4da6-b345-9216c98a05c2. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:25:52 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance network_info: |[{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Refreshing network info cache for port 2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start _get_guest_xml network_info=[{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:25:53 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:53 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'pci_devices' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:25:53 user nova-compute[75073]:   <uuid>6352329f-a8ce-4008-b736-737934dd1b52</uuid>
Nov 24 10:25:53 user nova-compute[75073]:   <name>instance-0000000f</name>
Nov 24 10:25:53 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:25:53 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:25:53 user nova-compute[75073]:   <metadata>
Nov 24 10:25:53 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:25:53 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherB-server-1321166727</nova:name>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:25:53</nova:creationTime>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:25:53 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:25:53 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:owner>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:user uuid="42d05b01c17a48aa93bcd7a4078332d7">tempest-ServerActionsTestOtherB-1373511819-project-member</nova:user>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:project uuid="496d4b08c8784b6b8afeb105d7fef10f">tempest-ServerActionsTestOtherB-1373511819</nova:project>
Nov 24 10:25:53 user nova-compute[75073]:       </nova:owner>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:25:53 user nova-compute[75073]:       <nova:ports>
Nov 24 10:25:53 user nova-compute[75073]:         <nova:port uuid="2345385d-d91c-4da6-b345-9216c98a05c2">
Nov 24 10:25:53 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:25:53 user nova-compute[75073]:         </nova:port>
Nov 24 10:25:53 user nova-compute[75073]:       </nova:ports>
Nov 24 10:25:53 user nova-compute[75073]:     </nova:instance>
Nov 24 10:25:53 user nova-compute[75073]:   </metadata>
Nov 24 10:25:53 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:25:53 user nova-compute[75073]:     <system>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="serial">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="uuid">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:25:53 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:25:53 user nova-compute[75073]:     </system>
Nov 24 10:25:53 user nova-compute[75073]:   </sysinfo>
Nov 24 10:25:53 user nova-compute[75073]:   <os>
Nov 24 10:25:53 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:25:53 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:25:53 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:25:53 user nova-compute[75073]:   </os>
Nov 24 10:25:53 user nova-compute[75073]:   <features>
Nov 24 10:25:53 user nova-compute[75073]:     <acpi/>
Nov 24 10:25:53 user nova-compute[75073]:     <apic/>
Nov 24 10:25:53 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:25:53 user nova-compute[75073]:   </features>
Nov 24 10:25:53 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:25:53 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:25:53 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:25:53 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:25:53 user nova-compute[75073]:   </clock>
Nov 24 10:25:53 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:25:53 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:25:53 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:25:53 user nova-compute[75073]:   </cpu>
Nov 24 10:25:53 user nova-compute[75073]:   <devices>
Nov 24 10:25:53 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:25:53 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:25:53 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk"/>
Nov 24 10:25:53 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:25:53 user nova-compute[75073]:     </disk>
Nov 24 10:25:53 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:25:53 user nova-compute[75073]:       <mac address="fa:16:3e:74:2d:dc"/>
Nov 24 10:25:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:53 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:25:53 user nova-compute[75073]:       <target dev="tap2345385d-d9"/>
Nov 24 10:25:53 user nova-compute[75073]:     </interface>
Nov 24 10:25:53 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:25:53 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/console.log" append="off"/>
Nov 24 10:25:53 user nova-compute[75073]:     </serial>
Nov 24 10:25:53 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:25:53 user nova-compute[75073]:     <video>
Nov 24 10:25:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:25:53 user nova-compute[75073]:     </video>
Nov 24 10:25:53 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:25:53 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:25:53 user nova-compute[75073]:     </rng>
Nov 24 10:25:53 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:25:53 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:25:53 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:25:53 user nova-compute[75073]:     </memballoon>
Nov 24 10:25:53 user nova-compute[75073]:   </devices>
Nov 24 10:25:53 user nova-compute[75073]: </domain>
Nov 24 10:25:53 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG os_vif [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edbb0dc6-8255-571b-9ae8-a415c2788676', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2345385d-d9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2345385d-d9, col_values=(('qos', UUID('f5b0da62-8e7e-4230-b090-725b682e5b10')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2345385d-d9, col_values=(('external_ids', {'iface-id': '2345385d-d91c-4da6-b345-9216c98a05c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:2d:dc', 'vm-uuid': '6352329f-a8ce-4008-b736-737934dd1b52'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:53 user nova-compute[75073]: INFO os_vif [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] No waiting events found dispatching network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:53 user nova-compute[75073]: WARNING nova.compute.manager [req-ba68f673-845f-48ab-84f7-96f759f7eb19 req-4ca08f83-5eea-4fdd-b168-a38fe08f579a service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received unexpected event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 for instance with vm_state active and task_state None.
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No VIF found with MAC fa:16:3e:74:2d:dc, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updated VIF entry in instance network info cache for port 2345385d-d91c-4da6-b345-9216c98a05c2. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b821c338-092c-406c-bfbe-d49cc340b80d req-2eb7c90c-ac3c-45d4-b4b5-14bf3de88993 service nova] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:54 user nova-compute[75073]: INFO nova.compute.manager [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Terminating instance
Nov 24 10:25:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-unplugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Acquiring lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] No waiting events found dispatching network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:55 user nova-compute[75073]: WARNING nova.compute.manager [req-a5923cff-00c1-4f8d-97cf-d7b8ac0ab65b req-554987e6-cbb7-49d6-ad14-6b765b42aa46 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received unexpected event network-vif-plugged-fcf31f42-7b47-49a6-be6a-83eda2801879 for instance with vm_state active and task_state deleting.
Nov 24 10:25:55 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Instance destroyed successfully.
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lazy-loading 'resources' on Instance uuid ff8e177f-6cf4-4f93-b997-13ffacce99f1 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-478155882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1144101997',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBykznsiKhtNk1dKnYBZGNZ7KCZqM0k+zGr+S17XxvT2TBCUNPTHssN9KjDeEjRd/4HTS+WxmPdmHWLqw5NhT/MwY3aWLKr6FIcn+wHf/8SMA/aoQ8PfwW9HPYmxlLdwDA==',key_name='tempest-keypair-2053503047',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:24:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0d54989ce7c43ed9591752dfca4b618',ramdisk_id='',reservation_id='r-546terjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-834413643',owner_user_name='tempest-ServerActionsV293TestJSON-834413643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92552b1336c84ed3a664b4e081c1ab19',uuid=ff8e177f-6cf4-4f93-b997-13ffacce99f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converting VIF {"id": "fcf31f42-7b47-49a6-be6a-83eda2801879", "address": "fa:16:3e:bf:c2:ed", "network": {"id": "98825a1a-341f-4134-8237-1300dc67f16e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-113685553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0d54989ce7c43ed9591752dfca4b618", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf31f42-7b", "ovs_interfaceid": "fcf31f42-7b47-49a6-be6a-83eda2801879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_vif [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf31f42-7b, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a08a109f-7f70-4791-a280-e5db053509df) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:25:55 user nova-compute[75073]: INFO os_vif [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c2:ed,bridge_name='br-int',has_traffic_filtering=True,id=fcf31f42-7b47-49a6-be6a-83eda2801879,network=Network(98825a1a-341f-4134-8237-1300dc67f16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf31f42-7b')
Nov 24 10:25:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nPoZXVSb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:25:55 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf4767-209e-4cae-ad5e-deab28f57149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:25:55 user nova-compute[75073]: No targets found.
Nov 24 10:25:55 user nova-compute[75073]: iSNS:
Nov 24 10:25:55 user nova-compute[75073]: No targets found.
Nov 24 10:25:55 user nova-compute[75073]: STATIC:
Nov 24 10:25:55 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603
Nov 24 10:25:55 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:25:55 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:25:55 user nova-compute[75073]: FIRMWARE:
Nov 24 10:25:55 user nova-compute[75073]: No targets found.
Nov 24 10:25:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:25:55 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:25:55 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b119f-468e-4144-b712-9a60d02f5f4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b45345-9db0-4c1e-b7f8-64d80fec8bda]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:25:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 (non-flash)
Nov 24 10:25:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238478af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6f676-3398-408d-8c31-e90dc592a3c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6186cad7-e4dc-4d50-bd4c-a286f88de9ab]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba7dba-af17-4eb1-b4bc-26c3a0727b6d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84d77f-d34e-465d-a2c3-cdc51cea8f62]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccacb30-aa6f-4d15-8df2-49765a172e37]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb392f48-ddc2-4b11-94ed-7f9135cbdf64]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260]
Nov 24 10:25:56 user nova-compute[75073]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603, portal: 172.16.0.220,3260] successful.
Nov 24 10:25:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c219be38-d43f-46f2-b035-d18e8225d603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b41750-47cc-43fc-bdd0-6bab430cfcae]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] <== disconnect_volume: return (402ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:25:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deleting instance files /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1_del
Nov 24 10:25:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deletion of /opt/stack/data/nova/instances/ff8e177f-6cf4-4f93-b997-13ffacce99f1_del complete
Nov 24 10:25:56 user nova-compute[75073]: INFO nova.compute.manager [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 24 10:25:56 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-b495ffac-f237-49e1-b8bf-c1e3f5745815 req-fbfa5f2d-5509-413f-a8ee-7ccd492e6329 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Received event network-vif-deleted-fcf31f42-7b47-49a6-be6a-83eda2801879 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:57 user nova-compute[75073]: INFO nova.compute.manager [req-b495ffac-f237-49e1-b8bf-c1e3f5745815 req-fbfa5f2d-5509-413f-a8ee-7ccd492e6329 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Neutron deleted interface fcf31f42-7b47-49a6-be6a-83eda2801879; detaching it from the instance and deleting it from the info cache
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-b495ffac-f237-49e1-b8bf-c1e3f5745815 req-fbfa5f2d-5509-413f-a8ee-7ccd492e6329 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:25:57 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Took 1.13 seconds to deallocate network for instance.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-b495ffac-f237-49e1-b8bf-c1e3f5745815 req-fbfa5f2d-5509-413f-a8ee-7ccd492e6329 service nova] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Detach interface failed, port_id=fcf31f42-7b47-49a6-be6a-83eda2801879, reason: Instance ff8e177f-6cf4-4f93-b997-13ffacce99f1 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:57 user nova-compute[75073]: WARNING nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state building and task_state spawning.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:25:57 user nova-compute[75073]: WARNING nova.compute.manager [req-89394f42-d1f5-46f6-a43f-836ad3c95c79 req-e69b2d61-9b98-4eed-be77-2f1d62a4dd31 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state building and task_state spawning.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:25:57 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance spawned successfully.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:25:57 user nova-compute[75073]: INFO nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:25:57 user nova-compute[75073]: INFO nova.compute.manager [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Took 8.27 seconds to build instance.
Nov 24 10:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0bd74939-2e84-4832-ab89-3102e8348a7f tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.368s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:58 user nova-compute[75073]: INFO nova.compute.manager [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Took 0.80 seconds to detach 1 volumes for instance.
Nov 24 10:25:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] [instance: ff8e177f-6cf4-4f93-b997-13ffacce99f1] Deleting volume: c219be38-d43f-46f2-b035-d18e8225d603 {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:25:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:25:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:25:58 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:25:58 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:25:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:25:58 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Deleted allocations for instance ff8e177f-6cf4-4f93-b997-13ffacce99f1
Nov 24 10:25:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14619972-380e-4d15-8d17-885cf8a55f0f tempest-ServerActionsV293TestJSON-834413643 tempest-ServerActionsV293TestJSON-834413643-project-member] Lock "ff8e177f-6cf4-4f93-b997-13ffacce99f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.120s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:10 user nova-compute[75073]: INFO nova.compute.manager [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Terminating instance
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Instance destroyed successfully.
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'resources' on Instance uuid 78f066a7-6d92-4161-a720-0eb2ae5cea72 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1855524810',display_name='tempest-VolumesAdminNegativeTest-server-1855524810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1855524810',id=11,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-z0ivi9c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:24:20Z,user_data=None,user_id='a09ba54648b745e6a09eed8514b7376a',uuid=78f066a7-6d92-4161-a720-0eb2ae5cea72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "address": "fa:16:3e:81:9c:6d", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd30b3c-f9", "ovs_interfaceid": "0dd30b3c-f96f-43fe-9d4f-6de8d5e771de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG os_vif [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dd30b3c-f9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d23ac85a-e964-4d4b-aa48-5ba7fb1840b4) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:10 user nova-compute[75073]: INFO os_vif [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9c:6d,bridge_name='br-int',has_traffic_filtering=True,id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd30b3c-f9')
Nov 24 10:26:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Deleting instance files /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72_del
Nov 24 10:26:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Deletion of /opt/stack/data/nova/instances/78f066a7-6d92-4161-a720-0eb2ae5cea72_del complete
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-unplugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] No waiting events found dispatching network-vif-unplugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:26:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-7893189c-98ad-44eb-8c0f-4663c830a95c req-56e6a80f-e8de-4203-af2a-bff82daf9eab service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-unplugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:26:11 user nova-compute[75073]: INFO nova.compute.manager [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 24 10:26:11 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:11 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Took 0.86 seconds to deallocate network for instance.
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-796c727a-885f-489a-8364-f1a50de33780 req-ce64ef5a-e1e0-42d3-aff3-0b7d580dc6e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-deleted-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:11 user nova-compute[75073]: INFO nova.compute.manager [req-796c727a-885f-489a-8364-f1a50de33780 req-ce64ef5a-e1e0-42d3-aff3-0b7d580dc6e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Neutron deleted interface 0dd30b3c-f96f-43fe-9d4f-6de8d5e771de; detaching it from the instance and deleting it from the info cache
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.network.neutron [req-796c727a-885f-489a-8364-f1a50de33780 req-ce64ef5a-e1e0-42d3-aff3-0b7d580dc6e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-796c727a-885f-489a-8364-f1a50de33780 req-ce64ef5a-e1e0-42d3-aff3-0b7d580dc6e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Detach interface failed, port_id=0dd30b3c-f96f-43fe-9d4f-6de8d5e771de, reason: Instance 78f066a7-6d92-4161-a720-0eb2ae5cea72 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.011s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:12 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:26:12 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:26:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:12 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Deleted allocations for instance 78f066a7-6d92-4161-a720-0eb2ae5cea72
Nov 24 10:26:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6b6a511-0115-41fe-867a-268d61db4070 tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.518s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] Acquiring lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] Lock "78f066a7-6d92-4161-a720-0eb2ae5cea72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] No waiting events found dispatching network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:26:13 user nova-compute[75073]: WARNING nova.compute.manager [req-81b6e42d-bf19-4a01-9276-82b06bb7fcb4 req-0fd65318-0fc5-4699-8835-a43a1abb44e8 service nova] [instance: 78f066a7-6d92-4161-a720-0eb2ae5cea72] Received unexpected event network-vif-plugged-0dd30b3c-f96f-43fe-9d4f-6de8d5e771de for instance with vm_state deleted and task_state None.
Nov 24 10:26:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:26:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:26:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:26:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:26:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:41 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:26:41 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:26:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=25.590999603271484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance facaa348-1d98-45d0-8ea8-77746a7f943f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 9097c72a-e947-44ec-8e2e-8ba4c025adb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:26:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:26:46 user nova-compute[75073]: INFO nova.compute.claims [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Claim successful on node user
Nov 24 10:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:26:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.policy [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '552125f8439c48fca5668206916d510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0940e25f15c427dbd88ded078b9dbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:26:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Creating image(s)
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "/opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "/opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.250s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk 1073741824" returned: 0 in 0.059s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Successfully created port: 581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Cannot resize image /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Ensure instance console log exists: /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Successfully updated port: 581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquired lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-changed-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Refreshing instance network info cache due to event network-changed-581149aa-d556-4a33-9ed6-78cb8f0ae528. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] Acquiring lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating instance_info_cache with network_info: [{"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Releasing lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Instance network_info: |[{"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] Acquired lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Refreshing network info cache for port 581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Start _get_guest_xml network_info=[{"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:26:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:26:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695566',id=16,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU7+A+MmVIN1F1dLIkSmJ9cFgMnifyUZxjsTa4EwOSABubkRUzMAHbdbSadn9K1XZRE/cSNVin+05hZziDafi54vel3eRTF9wb7Uuw5irOYq8DnIKcvwt3SPx7bfDgy5w==',key_name='tempest-keypair-1873303210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0940e25f15c427dbd88ded078b9dbe3',ramdisk_id='',reservation_id='r-bg0mapux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552125f8439c48fca5668206916d510e',uuid=a4c8ae56-7de9-4b3f-be92-8940c0317c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converting VIF {"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.objects.instance [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lazy-loading 'pci_devices' on Instance uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:26:48 user nova-compute[75073]:   <uuid>a4c8ae56-7de9-4b3f-be92-8940c0317c64</uuid>
Nov 24 10:26:48 user nova-compute[75073]:   <name>instance-00000010</name>
Nov 24 10:26:48 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:26:48 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:26:48 user nova-compute[75073]:   <metadata>
Nov 24 10:26:48 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:26:48 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074</nova:name>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:26:48</nova:creationTime>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:26:48 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:26:48 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:owner>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:user uuid="552125f8439c48fca5668206916d510e">tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member</nova:user>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:project uuid="c0940e25f15c427dbd88ded078b9dbe3">tempest-TestServerVolumeAttachScenarioOldVersion-857006206</nova:project>
Nov 24 10:26:48 user nova-compute[75073]:       </nova:owner>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:26:48 user nova-compute[75073]:       <nova:ports>
Nov 24 10:26:48 user nova-compute[75073]:         <nova:port uuid="581149aa-d556-4a33-9ed6-78cb8f0ae528">
Nov 24 10:26:48 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 24 10:26:48 user nova-compute[75073]:         </nova:port>
Nov 24 10:26:48 user nova-compute[75073]:       </nova:ports>
Nov 24 10:26:48 user nova-compute[75073]:     </nova:instance>
Nov 24 10:26:48 user nova-compute[75073]:   </metadata>
Nov 24 10:26:48 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:26:48 user nova-compute[75073]:     <system>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="serial">a4c8ae56-7de9-4b3f-be92-8940c0317c64</entry>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="uuid">a4c8ae56-7de9-4b3f-be92-8940c0317c64</entry>
Nov 24 10:26:48 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:26:48 user nova-compute[75073]:     </system>
Nov 24 10:26:48 user nova-compute[75073]:   </sysinfo>
Nov 24 10:26:48 user nova-compute[75073]:   <os>
Nov 24 10:26:48 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:26:48 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:26:48 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:26:48 user nova-compute[75073]:   </os>
Nov 24 10:26:48 user nova-compute[75073]:   <features>
Nov 24 10:26:48 user nova-compute[75073]:     <acpi/>
Nov 24 10:26:48 user nova-compute[75073]:     <apic/>
Nov 24 10:26:48 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:26:48 user nova-compute[75073]:   </features>
Nov 24 10:26:48 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:26:48 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:26:48 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:26:48 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:26:48 user nova-compute[75073]:   </clock>
Nov 24 10:26:48 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:26:48 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:26:48 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:26:48 user nova-compute[75073]:   </cpu>
Nov 24 10:26:48 user nova-compute[75073]:   <devices>
Nov 24 10:26:48 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:26:48 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:26:48 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk"/>
Nov 24 10:26:48 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:26:48 user nova-compute[75073]:     </disk>
Nov 24 10:26:48 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:26:48 user nova-compute[75073]:       <mac address="fa:16:3e:f9:5d:f9"/>
Nov 24 10:26:48 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:26:48 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:26:48 user nova-compute[75073]:       <target dev="tap581149aa-d5"/>
Nov 24 10:26:48 user nova-compute[75073]:     </interface>
Nov 24 10:26:48 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:26:48 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/console.log" append="off"/>
Nov 24 10:26:48 user nova-compute[75073]:     </serial>
Nov 24 10:26:48 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:26:48 user nova-compute[75073]:     <video>
Nov 24 10:26:48 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:26:48 user nova-compute[75073]:     </video>
Nov 24 10:26:48 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:26:48 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:26:48 user nova-compute[75073]:     </rng>
Nov 24 10:26:48 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:26:48 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:26:48 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:26:48 user nova-compute[75073]:     </memballoon>
Nov 24 10:26:48 user nova-compute[75073]:   </devices>
Nov 24 10:26:48 user nova-compute[75073]: </domain>
Nov 24 10:26:48 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695566',id=16,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU7+A+MmVIN1F1dLIkSmJ9cFgMnifyUZxjsTa4EwOSABubkRUzMAHbdbSadn9K1XZRE/cSNVin+05hZziDafi54vel3eRTF9wb7Uuw5irOYq8DnIKcvwt3SPx7bfDgy5w==',key_name='tempest-keypair-1873303210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0940e25f15c427dbd88ded078b9dbe3',ramdisk_id='',reservation_id='r-bg0mapux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552125f8439c48fca5668206916d510e',uuid=a4c8ae56-7de9-4b3f-be92-8940c0317c64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converting VIF {"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG os_vif [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ae2b01d-2397-5862-bd22-fa6df1aa9631', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap581149aa-d5, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap581149aa-d5, col_values=(('qos', UUID('c68372d1-5bcd-4e17-8ccc-cefcfe3a0100')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap581149aa-d5, col_values=(('external_ids', {'iface-id': '581149aa-d556-4a33-9ed6-78cb8f0ae528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:5d:f9', 'vm-uuid': 'a4c8ae56-7de9-4b3f-be92-8940c0317c64'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: INFO os_vif [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5')
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] No VIF found with MAC fa:16:3e:f9:5d:f9, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updated VIF entry in instance network info cache for port 581149aa-d556-4a33-9ed6-78cb8f0ae528. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG nova.network.neutron [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating instance_info_cache with network_info: [{"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b8406d2-1b9f-440b-9237-9dfae4960c0b req-2c70f698-5978-496f-98dd-2afedd83f96b service nova] Releasing lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:26:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] No waiting events found dispatching network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:26:50 user nova-compute[75073]: WARNING nova.compute.manager [req-3a06ea0a-837c-4ef1-b5d1-1376b9e194a2 req-d8e0e415-fdc9-45fc-a0d8-e5fa6c409f8b service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received unexpected event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 for instance with vm_state building and task_state spawning.
Nov 24 10:26:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:26:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Instance spawned successfully.
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] No waiting events found dispatching network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:26:52 user nova-compute[75073]: WARNING nova.compute.manager [req-99d3283a-86a8-4fb2-8a4c-f30deb08f835 req-748ac791-bc1d-4896-9292-8dd8415a7378 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received unexpected event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 for instance with vm_state building and task_state spawning.
Nov 24 10:26:52 user nova-compute[75073]: INFO nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 24 10:26:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:26:52 user nova-compute[75073]: INFO nova.compute.manager [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Took 6.46 seconds to build instance.
Nov 24 10:26:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23c3130b-0d0b-4362-a681-65f9597ae2d3 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.588s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lazy-loading 'flavor' on Instance uuid 9097c72a-e947-44ec-8e2e-8ba4c025adb5 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:26:54 user nova-compute[75073]: INFO nova.compute.manager [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Attaching volume 1edae04d-3788-49fc-9d06-3f4e4cd16992 to /dev/vdb
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.utils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[32258fe2-4e60-461b-9f51-26f451a02d8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3fdee-16bf-45e0-89a2-e422bdfd870f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec119df-c882-4408-9bab-f6b05407344d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb46ba1-e0f3-4454-8d41-12ee37d1ab53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:26:54 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:26:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1355e0-6ba1-4cf7-9e8c-7d201b66509f]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG os_brick.utils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:26:54 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Updating existing volume attachment record: e78ff688-5a07-4219-94de-fd51d9642723 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:26:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:26:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing instance network info cache due to event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:26:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:26:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:26:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:26:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated VIF entry in instance network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:26:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:26:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6af1d11b-19ab-4ecd-af2c-77f1536cd083 req-a46fce27-e3b3-4557-b456-8fa87b3f1704 service nova] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:26:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:26:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsNfctqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:27:00 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:27:00 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:27:00 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec23c67-e76a-4547-a769-d191562b12fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:27:00 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e6280-e235-4f96-b733-ac4122ac60f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992] added
Nov 24 10:27:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[326357c1-0eb8-4ed6-ae04-96f4f4dd259e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f0e50-291e-4228-b79c-c9d34af7f18b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsNfctqr {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsNfctqr" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b175847-f1ea-450b-a2a5-c6a1139402ea]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsNfctqr'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefaece-bf73-4046-8c98-2657e8392049]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd835d5-e6ff-4247-bc67-dc60302be451]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:27:00 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:27:00 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:27:00 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:27:00 user nova-compute[75073]: 
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90374a33-bb67-4bfa-ba53-c3e07d2a608b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260]
Nov 24 10:27:00 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260] successful.
Nov 24 10:27:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b81244b-6968-4653-a2cd-553a551e5d80]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0bc7e-56e2-41b3-bd39-09e7df6f7e07]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)
Nov 24 10:27:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)
Nov 24 10:27:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4205b-ff6e-4e28-93b5-72517dd5d184]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:27:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsNfctqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:27:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23762646231633536', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:27:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762646231633536', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:27:01 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lazy-loading 'flavor' on Instance uuid 9097c72a-e947-44ec-8e2e-8ba4c025adb5 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:27:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:27:02 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:27:02 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:27:02 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:27:02 user nova-compute[75073]:   <serial>1edae04d-3788-49fc-9d06-3f4e4cd16992</serial>
Nov 24 10:27:02 user nova-compute[75073]: </disk>
Nov 24 10:27:02 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:27:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:27:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:27:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] No VIF found with MAC fa:16:3e:ed:70:4b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:27:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4c47e9a1-7aef-4527-b0f5-b2934362c1a1 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.430s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:03 user nova-compute[75073]: INFO nova.compute.manager [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Terminating instance
Nov 24 10:27:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-unplugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] No waiting events found dispatching network-vif-unplugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-62946346-375a-4723-b95a-1e341ae52052 req-c66ad71a-ccd7-4d9a-ad37-f17f4811f3a4 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-unplugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:27:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Instance destroyed successfully.
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lazy-loading 'resources' on Instance uuid 9097c72a-e947-44ec-8e2e-8ba4c025adb5 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-461550238',display_name='tempest-DeleteServersTestJSON-server-461550238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-461550238',id=12,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21897c36caac4b01a9f42f336570b19d',ramdisk_id='',reservation_id='r-8dgj9wu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1843289919',owner_user_name='tempest-DeleteServersTestJSON-1843289919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:25:08Z,user_data=None,user_id='7ed52b6310e348f180cb2fb8505eb57e',uuid=9097c72a-e947-44ec-8e2e-8ba4c025adb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converting VIF {"id": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "address": "fa:16:3e:ed:70:4b", "network": {"id": "b06049cd-51e9-4440-a692-ee2dba02fa5e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1610533203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21897c36caac4b01a9f42f336570b19d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee865cc-e9", "ovs_interfaceid": "6ee865cc-e9b8-447a-a856-2a6b1d2de6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_vif [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ee865cc-e9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a095dbc0-b09a-425c-9bd5-d3b6e1437781) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: INFO os_vif [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:70:4b,bridge_name='br-int',has_traffic_filtering=True,id=6ee865cc-e9b8-447a-a856-2a6b1d2de6f6,network=Network(b06049cd-51e9-4440-a692-ee2dba02fa5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee865cc-e9')
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsNfctqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:27:04 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d675fbae-a804-4711-9dd4-4e2f9d1cc510]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:27:04 user nova-compute[75073]: No targets found.
Nov 24 10:27:04 user nova-compute[75073]: iSNS:
Nov 24 10:27:04 user nova-compute[75073]: No targets found.
Nov 24 10:27:04 user nova-compute[75073]: STATIC:
Nov 24 10:27:04 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992
Nov 24 10:27:04 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:27:04 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:27:04 user nova-compute[75073]: FIRMWARE:
Nov 24 10:27:04 user nova-compute[75073]: No targets found.
Nov 24 10:27:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:27:04 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:27:04 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69022f9-ee23-48df-a795-ed4894f935cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d658d-e226-4758-b6e5-2db46f25d682]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)
Nov 24 10:27:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 (non-flash)
Nov 24 10:27:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23825d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:04 user nova-compute[75073]: INFO nova.compute.manager [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Terminating instance
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b399a86-05ba-46f6-a39e-379439a56212]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac6ba6-9699-4f5d-9ffe-8a82d1210f8e]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe6109-887e-4223-b4e8-e101e221ce14]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386f4a5-c2d4-4a50-a620-50888cd650db]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5f512-7c4d-4685-808b-f893ea20b273]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d26753-99ff-4427-ac19-ba5c4fa06b4d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260]
Nov 24 10:27:04 user nova-compute[75073]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992, portal: 172.16.0.220,3260] successful.
Nov 24 10:27:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1edae04d-3788-49fc-9d06-3f4e4cd16992 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3691c3f5-7dd1-4973-97d8-c4a66c019bed]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] <== disconnect_volume: return (333ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:27:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Deleting instance files /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5_del
Nov 24 10:27:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Deletion of /opt/stack/data/nova/instances/9097c72a-e947-44ec-8e2e-8ba4c025adb5_del complete
Nov 24 10:27:04 user nova-compute[75073]: INFO nova.compute.manager [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 24 10:27:04 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:27:04 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Instance destroyed successfully.
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lazy-loading 'resources' on Instance uuid facaa348-1d98-45d0-8ea8-77746a7f943f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1504972674',display_name='tempest-VolumesAdminNegativeTest-server-1504972674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1504972674',id=3,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNavL9I3BzmusxCesLV64P81WQWvO4lfNsoUBYDdHeSd4cLQ39vlPByusSbmGbrBIfB/Pz24XDfQLBm+139xmOl/az+RwpTwucEzuFMcfnAQaR2mBKRk/D5SXYkRuopmg==',key_name='tempest-keypair-2034053659',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8bcfd0f8a9fe42ada311dcc1047b3c79',ramdisk_id='',reservation_id='r-ln8506sp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1494900621',owner_user_name='tempest-VolumesAdminNegativeTest-1494900621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09ba54648b745e6a09eed8514b7376a',uuid=facaa348-1d98-45d0-8ea8-77746a7f943f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converting VIF {"id": "4b42b912-6f43-459a-8b4f-09678aa5d133", "address": "fa:16:3e:29:9b:30", "network": {"id": "c418f5f6-9414-4710-8d1b-67ff39b4dffa", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-945379957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8bcfd0f8a9fe42ada311dcc1047b3c79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b42b912-6f", "ovs_interfaceid": "4b42b912-6f43-459a-8b4f-09678aa5d133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG os_vif [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b42b912-6f, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63e9f070-4ca9-43f1-904e-2deec5a0390a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:05 user nova-compute[75073]: INFO os_vif [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:9b:30,bridge_name='br-int',has_traffic_filtering=True,id=4b42b912-6f43-459a-8b4f-09678aa5d133,network=Network(c418f5f6-9414-4710-8d1b-67ff39b4dffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b42b912-6f')
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Deleting instance files /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f_del
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Deletion of /opt/stack/data/nova/instances/facaa348-1d98-45d0-8ea8-77746a7f943f_del complete
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.compute.manager [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Took 0.80 seconds to deallocate network for instance.
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Acquiring lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] No waiting events found dispatching network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:05 user nova-compute[75073]: WARNING nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received unexpected event network-vif-plugged-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 for instance with vm_state active and task_state deleting.
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-unplugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] No waiting events found dispatching network-vif-unplugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-unplugged-4b42b912-6f43-459a-8b4f-09678aa5d133 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Acquiring lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] No waiting events found dispatching network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:05 user nova-compute[75073]: WARNING nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received unexpected event network-vif-plugged-4b42b912-6f43-459a-8b4f-09678aa5d133 for instance with vm_state active and task_state deleting.
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3d380f1-cbeb-4c73-9792-582a36d30781 req-11b9a154-11d0-4b2f-8016-aea4a64ad046 service nova] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Received event network-vif-deleted-6ee865cc-e9b8-447a-a856-2a6b1d2de6f6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:05 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:05 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Took 0.78 seconds to deallocate network for instance.
Nov 24 10:27:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-b37669f1-ea9f-4423-82ba-968adbdb04fa req-f919b5cd-17cf-4f7b-b759-27addf315b84 service nova] [instance: facaa348-1d98-45d0-8ea8-77746a7f943f] Received event network-vif-deleted-4b42b912-6f43-459a-8b4f-09678aa5d133 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:06 user nova-compute[75073]: INFO nova.compute.manager [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] [instance: 9097c72a-e947-44ec-8e2e-8ba4c025adb5] Took 1.28 seconds to detach 1 volumes for instance.
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.727s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.098s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:06 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Deleted allocations for instance facaa348-1d98-45d0-8ea8-77746a7f943f
Nov 24 10:27:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f21e852d-fbd5-494d-840f-6ee53fbd79ff tempest-VolumesAdminNegativeTest-1494900621 tempest-VolumesAdminNegativeTest-1494900621-project-member] Lock "facaa348-1d98-45d0-8ea8-77746a7f943f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:07 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:27:07 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:27:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:07 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Deleted allocations for instance 9097c72a-e947-44ec-8e2e-8ba4c025adb5
Nov 24 10:27:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-39d5f28e-cf32-416d-9e11-d842cfe8d4b5 tempest-DeleteServersTestJSON-1843289919 tempest-DeleteServersTestJSON-1843289919-project-member] Lock "9097c72a-e947-44ec-8e2e-8ba4c025adb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.993s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:21 user nova-compute[75073]: INFO nova.compute.manager [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Unrescuing
Nov 24 10:27:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:27:21 user nova-compute[75073]: DEBUG nova.objects.instance [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'flavor' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:22 user nova-compute[75073]: WARNING nova.compute.manager [req-952509e3-8fac-4026-a581-f3bce79eb964 req-7750a7cc-288b-489c-8aee-1b0211f569d0 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:27:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance destroyed successfully.
Nov 24 10:27:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:27:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:23 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:27:23 user nova-compute[75073]: INFO nova.compute.claims [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Claim successful on node user
Nov 24 10:27:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:24 user nova-compute[75073]: WARNING nova.compute.manager [req-2987c43f-6e92-421d-8696-c0c499b173ec req-45f851d9-5453-45fe-a039-3cc470da087b service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:27:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:27:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.policy [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0ba89c696b646568b211c45f22a7280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f96b94b81421e97b8fab10358d712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:27:24 user nova-compute[75073]: INFO nova.virt.block_device [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Booting with volume c717a11b-b615-450d-8c37-dd726611db11 at /dev/vda
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.utils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd311e6-9161-4b14-972f-d597ccc3431a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdab67d-4f5e-41dc-9cfb-16913e29c906]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dff72b-86e3-4503-87fc-1d9e061721fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9993d-18b3-44bf-8b77-dd0e4d06e893]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:27:24 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:27:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b634be8-9620-4e7d-880c-8278a03fe947]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG os_brick.utils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:27:24 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating existing volume attachment record: 66f7ecb0-a989-4a41-9ffa-0195bbb00c1b {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Successfully created port: b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Successfully updated port: b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing instance network info cache due to event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:27:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance network_info: |[{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-179570ae-62ac-420c-ae0e-5dca6227cc03 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:26 user nova-compute[75073]: WARNING nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state None.
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:26 user nova-compute[75073]: WARNING nova.compute.manager [req-12211948-4b9a-40fa-a058-c903c25d4ba0 req-c8a3eae5-ccce-4faf-a7d6-daf6d443f098 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state active and task_state None.
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updated VIF entry in instance network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b25aa85-a8f9-4c63-bed9-eb8dfddaa894 req-4e9a232c-b715-4193-9730-b320042ec277 service nova] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:27:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:27:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Creating image(s)
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Ensure instance console log exists: /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start _get_guest_xml network_info=[{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '66f7ecb0-a989-4a41-9ffa-0195bbb00c1b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bb2d27-81da-4ef6-a631-39ee7edd35c3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c717a11b-b615-450d-8c37-dd726611db11', 'serial': 'c717a11b-b615-450d-8c37-dd726611db11'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:27:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:27:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:27:30 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:27:30 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:27:30 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba772e4-0deb-4582-a3e3-e842d191b90a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:27:30 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2514cd-abb7-4731-8e7c-bf099f4dec07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11] added
Nov 24 10:27:30 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949106f-46dc-4099-b4a7-01ec9dcdc67c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48389628-75bc-4266-b3a1-a1b99bdf722d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTMFYqEV {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTMFYqEV" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07276d4b-b28f-4809-88a8-9ecd9020ad74]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTMFYqEV'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c7a92-3ca9-4d34-bd98-b478e1778f84]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc686fb-7b63-4f70-91a1-957b6d852d24]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:27:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:27:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:27:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:27:31 user nova-compute[75073]: 
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f994bcb-5520-495e-af14-49fd780a82c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]
Nov 24 10:27:31 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.
Nov 24 10:27:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9e231-cd8d-440f-888d-040e511a8488]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140eb19-5d7b-49c8-8c98-b084d666d277]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:27:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:27:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5912bdc3-b461-4082-918a-d460dbafdbdd]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:27:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23730386262343833', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730386262343833', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE0vzlQS+Ale4pn8cmHkdIcvb1/JfNkNZ/l7sHvPhTj+Id+QbzA44ZQgdp01+47H5RXzUGimXjG/DzdIpo0bymFfa5cc82Jty0t8iiRxUlBzyYpvKbKPmnB02mGogsj0Q==',key_name='tempest-TestShelveInstance-2012259995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:27:24Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'pci_devices' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:27:32 user nova-compute[75073]:   <uuid>26bb2d27-81da-4ef6-a631-39ee7edd35c3</uuid>
Nov 24 10:27:32 user nova-compute[75073]:   <name>instance-00000011</name>
Nov 24 10:27:32 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:27:32 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:27:32 user nova-compute[75073]:   <metadata>
Nov 24 10:27:32 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:27:32 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:27:32 user nova-compute[75073]:       <nova:name>tempest-TestShelveInstance-server-1516165204</nova:name>
Nov 24 10:27:32 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:27:30</nova:creationTime>
Nov 24 10:27:32 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:27:32 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:27:32 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:27:32 user nova-compute[75073]:       <nova:owner>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:user uuid="e0ba89c696b646568b211c45f22a7280">tempest-TestShelveInstance-1895340078-project-member</nova:user>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:project uuid="335f96b94b81421e97b8fab10358d712">tempest-TestShelveInstance-1895340078</nova:project>
Nov 24 10:27:32 user nova-compute[75073]:       </nova:owner>
Nov 24 10:27:32 user nova-compute[75073]:       <nova:ports>
Nov 24 10:27:32 user nova-compute[75073]:         <nova:port uuid="b31cc3bf-c039-4bb6-88e0-7669633eddad">
Nov 24 10:27:32 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 10:27:32 user nova-compute[75073]:         </nova:port>
Nov 24 10:27:32 user nova-compute[75073]:       </nova:ports>
Nov 24 10:27:32 user nova-compute[75073]:     </nova:instance>
Nov 24 10:27:32 user nova-compute[75073]:   </metadata>
Nov 24 10:27:32 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:27:32 user nova-compute[75073]:     <system>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="serial">26bb2d27-81da-4ef6-a631-39ee7edd35c3</entry>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="uuid">26bb2d27-81da-4ef6-a631-39ee7edd35c3</entry>
Nov 24 10:27:32 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:27:32 user nova-compute[75073]:     </system>
Nov 24 10:27:32 user nova-compute[75073]:   </sysinfo>
Nov 24 10:27:32 user nova-compute[75073]:   <os>
Nov 24 10:27:32 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:27:32 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:27:32 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:27:32 user nova-compute[75073]:   </os>
Nov 24 10:27:32 user nova-compute[75073]:   <features>
Nov 24 10:27:32 user nova-compute[75073]:     <acpi/>
Nov 24 10:27:32 user nova-compute[75073]:     <apic/>
Nov 24 10:27:32 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:27:32 user nova-compute[75073]:   </features>
Nov 24 10:27:32 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:27:32 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:27:32 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:27:32 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:27:32 user nova-compute[75073]:   </clock>
Nov 24 10:27:32 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:27:32 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:27:32 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:27:32 user nova-compute[75073]:   </cpu>
Nov 24 10:27:32 user nova-compute[75073]:   <devices>
Nov 24 10:27:32 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:27:32 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:27:32 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:27:32 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:27:32 user nova-compute[75073]:       <serial>c717a11b-b615-450d-8c37-dd726611db11</serial>
Nov 24 10:27:32 user nova-compute[75073]:     </disk>
Nov 24 10:27:32 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:27:32 user nova-compute[75073]:       <mac address="fa:16:3e:ff:d2:86"/>
Nov 24 10:27:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:27:32 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:27:32 user nova-compute[75073]:       <target dev="tapb31cc3bf-c0"/>
Nov 24 10:27:32 user nova-compute[75073]:     </interface>
Nov 24 10:27:32 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:27:32 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3/console.log" append="off"/>
Nov 24 10:27:32 user nova-compute[75073]:     </serial>
Nov 24 10:27:32 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:27:32 user nova-compute[75073]:     <video>
Nov 24 10:27:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:27:32 user nova-compute[75073]:     </video>
Nov 24 10:27:32 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:27:32 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:27:32 user nova-compute[75073]:     </rng>
Nov 24 10:27:32 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:27:32 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:27:32 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:27:32 user nova-compute[75073]:     </memballoon>
Nov 24 10:27:32 user nova-compute[75073]:   </devices>
Nov 24 10:27:32 user nova-compute[75073]: </domain>
Nov 24 10:27:32 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE0vzlQS+Ale4pn8cmHkdIcvb1/JfNkNZ/l7sHvPhTj+Id+QbzA44ZQgdp01+47H5RXzUGimXjG/DzdIpo0bymFfa5cc82Jty0t8iiRxUlBzyYpvKbKPmnB02mGogsj0Q==',key_name='tempest-TestShelveInstance-2012259995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:27:24Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG os_vif [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627a5c18-959e-57fe-80f8-c70365a5bfcd', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb31cc3bf-c0, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb31cc3bf-c0, col_values=(('qos', UUID('d1333669-6d35-42c1-b37b-a0b7607db30a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb31cc3bf-c0, col_values=(('external_ids', {'iface-id': 'b31cc3bf-c039-4bb6-88e0-7669633eddad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:d2:86', 'vm-uuid': '26bb2d27-81da-4ef6-a631-39ee7edd35c3'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:32 user nova-compute[75073]: INFO os_vif [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0')
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:27:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] No VIF found with MAC fa:16:3e:ff:d2:86, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:27:33 user nova-compute[75073]: INFO nova.compute.manager [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] instance snapshotting
Nov 24 10:27:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Beginning live snapshot process
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:33 user nova-compute[75073]: WARNING nova.compute.manager [req-3cf53bcb-dac9-452d-aa4d-40db0e2b2944 req-f2ed0aa8-dda6-459e-9943-f032bc3bb4ce service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state building and task_state spawning.
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec.delta 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec.delta 1073741824" returned: 0 in 0.063s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 10:27:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:27:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec.delta /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:27:35 user nova-compute[75073]: WARNING nova.compute.manager [req-f47ad2af-a09d-43d7-a123-8c622ed7734e req-28b8e315-e3c9-415a-81d8-c1bdfd268eb9 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state building and task_state spawning.
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 06ed6f5a-958b-4414-9dbd-69641b193367 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 5945a479-75dc-4018-a7cd-80c5ab25b67c {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "368baad5-b756-4ae5-aa18-9d148632523d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: INFO nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "6352329f-a8ce-4008-b736-737934dd1b52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec.delta /opt/stack/data/nova/instances/snapshots/tmp2eamqfi4/9c169973238d41af83659a813dc882ec" returned: 0 in 0.426s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Snapshot extracted, beginning image upload
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "368baad5-b756-4ae5-aa18-9d148632523d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "6352329f-a8ce-4008-b736-737934dd1b52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:27:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance spawned successfully.
Nov 24 10:27:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:27:36 user nova-compute[75073]: INFO nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 24 10:27:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:27:36 user nova-compute[75073]: INFO nova.compute.manager [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Took 12.59 seconds to build instance.
Nov 24 10:27:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-69affff9-2820-4041-b81f-104833df8519 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.686s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.445s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:36 user nova-compute[75073]: INFO nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 24 10:27:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:27:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:27:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:39 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Snapshot image upload complete
Nov 24 10:27:39 user nova-compute[75073]: INFO nova.compute.manager [None req-8a23f0ff-f966-419f-befd-d8068a6c4c99 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Took 6.11 seconds to snapshot the instance on the hypervisor.
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-changed-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Refreshing instance network info cache due to event network-changed-2345385d-d91c-4da6-b345-9216c98a05c2. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Refreshing network info cache for port 2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updated VIF entry in instance network info cache for port 2345385d-d91c-4da6-b345-9216c98a05c2. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6d5f3e58-16b0-4fbb-80e2-0ddc8f993826 req-fa4f583b-c80a-4637-9da5-122cdc77110c service nova] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:27:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:27:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7950MB free_disk=25.514312744140625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:27:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:27:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:44 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:27:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:27:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:28:00 user nova-compute[75073]: INFO nova.compute.claims [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Claim successful on node user
Nov 24 10:28:00 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:28:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:28:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.policy [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dffd5f6353e344aa96a97235372632fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4665d407280c4667beadb1678e105480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:28:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Creating image(s)
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.244s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk 1073741824" returned: 0 in 0.056s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Cannot resize image /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Ensure instance console log exists: /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Successfully created port: 3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Successfully updated port: 3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-changed-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Refreshing instance network info cache due to event network-changed-3553e048-612e-49d7-8cdb-6cf7a4107f5b. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] Acquiring lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating instance_info_cache with network_info: [{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance network_info: |[{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] Acquired lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Refreshing network info cache for port 3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start _get_guest_xml network_info=[{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:28:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-tempest.common.compute-instance-968903813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'pci_devices' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:28:04 user nova-compute[75073]:   <uuid>52a44464-e0d3-4620-9d54-37fd4d82d32c</uuid>
Nov 24 10:28:04 user nova-compute[75073]:   <name>instance-00000012</name>
Nov 24 10:28:04 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:28:04 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:28:04 user nova-compute[75073]:   <metadata>
Nov 24 10:28:04 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:28:04 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:name>tempest-tempest.common.compute-instance-968903813</nova:name>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:28:04</nova:creationTime>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:28:04 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:28:04 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:owner>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:user uuid="dffd5f6353e344aa96a97235372632fd">tempest-ServerActionsTestOtherA-371935856-project-member</nova:user>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:project uuid="4665d407280c4667beadb1678e105480">tempest-ServerActionsTestOtherA-371935856</nova:project>
Nov 24 10:28:04 user nova-compute[75073]:       </nova:owner>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:28:04 user nova-compute[75073]:       <nova:ports>
Nov 24 10:28:04 user nova-compute[75073]:         <nova:port uuid="3553e048-612e-49d7-8cdb-6cf7a4107f5b">
Nov 24 10:28:04 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:28:04 user nova-compute[75073]:         </nova:port>
Nov 24 10:28:04 user nova-compute[75073]:       </nova:ports>
Nov 24 10:28:04 user nova-compute[75073]:     </nova:instance>
Nov 24 10:28:04 user nova-compute[75073]:   </metadata>
Nov 24 10:28:04 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:28:04 user nova-compute[75073]:     <system>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="serial">52a44464-e0d3-4620-9d54-37fd4d82d32c</entry>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="uuid">52a44464-e0d3-4620-9d54-37fd4d82d32c</entry>
Nov 24 10:28:04 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:28:04 user nova-compute[75073]:     </system>
Nov 24 10:28:04 user nova-compute[75073]:   </sysinfo>
Nov 24 10:28:04 user nova-compute[75073]:   <os>
Nov 24 10:28:04 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:28:04 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:28:04 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:28:04 user nova-compute[75073]:   </os>
Nov 24 10:28:04 user nova-compute[75073]:   <features>
Nov 24 10:28:04 user nova-compute[75073]:     <acpi/>
Nov 24 10:28:04 user nova-compute[75073]:     <apic/>
Nov 24 10:28:04 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:28:04 user nova-compute[75073]:   </features>
Nov 24 10:28:04 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:28:04 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:28:04 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:28:04 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:28:04 user nova-compute[75073]:   </clock>
Nov 24 10:28:04 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:28:04 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:28:04 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:28:04 user nova-compute[75073]:   </cpu>
Nov 24 10:28:04 user nova-compute[75073]:   <devices>
Nov 24 10:28:04 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:28:04 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:28:04 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk"/>
Nov 24 10:28:04 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:28:04 user nova-compute[75073]:     </disk>
Nov 24 10:28:04 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:28:04 user nova-compute[75073]:       <mac address="fa:16:3e:8d:d9:5a"/>
Nov 24 10:28:04 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:04 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:28:04 user nova-compute[75073]:       <target dev="tap3553e048-61"/>
Nov 24 10:28:04 user nova-compute[75073]:     </interface>
Nov 24 10:28:04 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:28:04 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/console.log" append="off"/>
Nov 24 10:28:04 user nova-compute[75073]:     </serial>
Nov 24 10:28:04 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:28:04 user nova-compute[75073]:     <video>
Nov 24 10:28:04 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:04 user nova-compute[75073]:     </video>
Nov 24 10:28:04 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:28:04 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:28:04 user nova-compute[75073]:     </rng>
Nov 24 10:28:04 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:28:04 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:28:04 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:28:04 user nova-compute[75073]:     </memballoon>
Nov 24 10:28:04 user nova-compute[75073]:   </devices>
Nov 24 10:28:04 user nova-compute[75073]: </domain>
Nov 24 10:28:04 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-tempest.common.compute-instance-968903813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG os_vif [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd08a00f1-8e9b-56c9-a75b-a5401464e0a3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3553e048-61, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3553e048-61, col_values=(('qos', UUID('726ae23a-0d87-4213-b36d-c143f37bcca4')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3553e048-61, col_values=(('external_ids', {'iface-id': '3553e048-612e-49d7-8cdb-6cf7a4107f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:d9:5a', 'vm-uuid': '52a44464-e0d3-4620-9d54-37fd4d82d32c'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:04 user nova-compute[75073]: INFO os_vif [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61')
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:8d:d9:5a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updated VIF entry in instance network info cache for port 3553e048-612e-49d7-8cdb-6cf7a4107f5b. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating instance_info_cache with network_info: [{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34e165eb-6985-4c5e-a15f-bef5735e792e req-afdbd0ed-cd44-40f3-aec4-10a7eaa377fd service nova] Releasing lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:28:06 user nova-compute[75073]: WARNING nova.compute.manager [req-53df6dd0-5905-48e6-a9db-4f48a27691ee req-9d162d71-3df9-445b-93d2-f5d5cbfff63f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state building and task_state spawning.
Nov 24 10:28:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:28:08 user nova-compute[75073]: WARNING nova.compute.manager [req-b3d34c57-2753-43ab-b832-4392bd5e4251 req-319c4b9f-9673-4822-a72d-d931866a9c65 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state building and task_state spawning.
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:28:08 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance spawned successfully.
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:08 user nova-compute[75073]: INFO nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 24 10:28:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:28:08 user nova-compute[75073]: INFO nova.compute.manager [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Took 7.99 seconds to build instance.
Nov 24 10:28:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ad24085f-91ae-44f4-abb4-b1712a3a2548 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.126s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:28:16 user nova-compute[75073]: INFO nova.compute.claims [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Claim successful on node user
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:28:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.policy [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e945ba41be374114af0acb30cea23c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3012c563042da9cf3f61dac69d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:28:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Creating image(s)
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.211s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk 1073741824" returned: 0 in 0.058s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Successfully created port: dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.202s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Cannot resize image /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Ensure instance console log exists: /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Successfully updated port: dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing instance network info cache due to event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance network_info: |[{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start _get_guest_xml network_info=[{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:28:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-950738275',display_name='tempest-ServerStableDeviceRescueTest-server-950738275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-950738275',id=19,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdZ5PWkX8bfykVY2l8KJWvIRywALd2orQ4pyUssBpDc23j4tCwwoKXQPogM4FIiMY3nqQSfZEej4LrqxQcCWnpAHgsx6N6SG/7v4/Lax41EvxzA/qM/TFD6uwDG0mqLLw==',key_name='tempest-keypair-1817962517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b3012c563042da9cf3f61dac69d570',ramdisk_id='',reservation_id='r-wryojn74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-987992993',owner_user_name='tempest-ServerStableDeviceRescueTest-987992993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e945ba41be374114af0acb30cea23c96',uuid=22994ffd-5bf9-460c-a04a-2b206c7fd02f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converting VIF {"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'pci_devices' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:28:19 user nova-compute[75073]:   <uuid>22994ffd-5bf9-460c-a04a-2b206c7fd02f</uuid>
Nov 24 10:28:19 user nova-compute[75073]:   <name>instance-00000013</name>
Nov 24 10:28:19 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:28:19 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:28:19 user nova-compute[75073]:   <metadata>
Nov 24 10:28:19 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:28:19 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-950738275</nova:name>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:28:19</nova:creationTime>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:28:19 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:28:19 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:owner>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:user uuid="e945ba41be374114af0acb30cea23c96">tempest-ServerStableDeviceRescueTest-987992993-project-member</nova:user>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:project uuid="b0b3012c563042da9cf3f61dac69d570">tempest-ServerStableDeviceRescueTest-987992993</nova:project>
Nov 24 10:28:19 user nova-compute[75073]:       </nova:owner>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:28:19 user nova-compute[75073]:       <nova:ports>
Nov 24 10:28:19 user nova-compute[75073]:         <nova:port uuid="dd74395e-1c17-4c29-b311-7457e29711ea">
Nov 24 10:28:19 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:28:19 user nova-compute[75073]:         </nova:port>
Nov 24 10:28:19 user nova-compute[75073]:       </nova:ports>
Nov 24 10:28:19 user nova-compute[75073]:     </nova:instance>
Nov 24 10:28:19 user nova-compute[75073]:   </metadata>
Nov 24 10:28:19 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:28:19 user nova-compute[75073]:     <system>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="serial">22994ffd-5bf9-460c-a04a-2b206c7fd02f</entry>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="uuid">22994ffd-5bf9-460c-a04a-2b206c7fd02f</entry>
Nov 24 10:28:19 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:28:19 user nova-compute[75073]:     </system>
Nov 24 10:28:19 user nova-compute[75073]:   </sysinfo>
Nov 24 10:28:19 user nova-compute[75073]:   <os>
Nov 24 10:28:19 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:28:19 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:28:19 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:28:19 user nova-compute[75073]:   </os>
Nov 24 10:28:19 user nova-compute[75073]:   <features>
Nov 24 10:28:19 user nova-compute[75073]:     <acpi/>
Nov 24 10:28:19 user nova-compute[75073]:     <apic/>
Nov 24 10:28:19 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:28:19 user nova-compute[75073]:   </features>
Nov 24 10:28:19 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:28:19 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:28:19 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:28:19 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:28:19 user nova-compute[75073]:   </clock>
Nov 24 10:28:19 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:28:19 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:28:19 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:28:19 user nova-compute[75073]:   </cpu>
Nov 24 10:28:19 user nova-compute[75073]:   <devices>
Nov 24 10:28:19 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:28:19 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:28:19 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk"/>
Nov 24 10:28:19 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:28:19 user nova-compute[75073]:     </disk>
Nov 24 10:28:19 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:28:19 user nova-compute[75073]:       <mac address="fa:16:3e:a0:c7:70"/>
Nov 24 10:28:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:19 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:28:19 user nova-compute[75073]:       <target dev="tapdd74395e-1c"/>
Nov 24 10:28:19 user nova-compute[75073]:     </interface>
Nov 24 10:28:19 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:28:19 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/console.log" append="off"/>
Nov 24 10:28:19 user nova-compute[75073]:     </serial>
Nov 24 10:28:19 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:28:19 user nova-compute[75073]:     <video>
Nov 24 10:28:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:19 user nova-compute[75073]:     </video>
Nov 24 10:28:19 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:28:19 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:28:19 user nova-compute[75073]:     </rng>
Nov 24 10:28:19 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:28:19 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:28:19 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:28:19 user nova-compute[75073]:     </memballoon>
Nov 24 10:28:19 user nova-compute[75073]:   </devices>
Nov 24 10:28:19 user nova-compute[75073]: </domain>
Nov 24 10:28:19 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-950738275',display_name='tempest-ServerStableDeviceRescueTest-server-950738275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-950738275',id=19,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdZ5PWkX8bfykVY2l8KJWvIRywALd2orQ4pyUssBpDc23j4tCwwoKXQPogM4FIiMY3nqQSfZEej4LrqxQcCWnpAHgsx6N6SG/7v4/Lax41EvxzA/qM/TFD6uwDG0mqLLw==',key_name='tempest-keypair-1817962517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b3012c563042da9cf3f61dac69d570',ramdisk_id='',reservation_id='r-wryojn74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-987992993',owner_user_name='tempest-ServerStableDeviceRescueTest-987992993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e945ba41be374114af0acb30cea23c96',uuid=22994ffd-5bf9-460c-a04a-2b206c7fd02f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converting VIF {"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG os_vif [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c250f42-9a46-5d9f-bb5e-185713d07ac1', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd74395e-1c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd74395e-1c, col_values=(('qos', UUID('3f5577bd-db7b-4157-86f0-9aea20c494bd')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd74395e-1c, col_values=(('external_ids', {'iface-id': 'dd74395e-1c17-4c29-b311-7457e29711ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:c7:70', 'vm-uuid': '22994ffd-5bf9-460c-a04a-2b206c7fd02f'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:19 user nova-compute[75073]: INFO os_vif [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c')
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No VIF found with MAC fa:16:3e:a0:c7:70, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updated VIF entry in instance network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5f88dd1d-82e7-4d6e-9648-4c03c6c8c7d2 req-1a00e1b7-83fd-4219-8d89-fa59fb58a73f service nova] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:28:20 user nova-compute[75073]: WARNING nova.compute.manager [req-eef9bf35-d131-4ad2-b779-8d46100be1b3 req-1e08e6da-c1c7-4f52-9614-c3e3fb7c6414 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state building and task_state spawning.
Nov 24 10:28:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:28:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance spawned successfully.
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:28:22 user nova-compute[75073]: INFO nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:28:22 user nova-compute[75073]: WARNING nova.compute.manager [req-d4574eb1-966b-4f32-ac54-f73be80e05cd req-3d231976-96ec-4f51-a8d3-8c1b7358db58 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state building and task_state spawning.
Nov 24 10:28:23 user nova-compute[75073]: INFO nova.compute.manager [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Took 6.16 seconds to build instance.
Nov 24 10:28:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0f148b7a-305a-4a3d-aa82-eb61c1fb90a7 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.272s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-changed-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Refreshing instance network info cache due to event network-changed-581149aa-d556-4a33-9ed6-78cb8f0ae528. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] Acquiring lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] Acquired lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.network.neutron [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Refreshing network info cache for port 581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.network.neutron [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updated VIF entry in instance network info cache for port 581149aa-d556-4a33-9ed6-78cb8f0ae528. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.network.neutron [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating instance_info_cache with network_info: [{"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ce3adaa-a808-4fdb-9334-a3335327bff6 req-4eabcebb-8f94-4262-96bf-07e96c55b3cc service nova] Releasing lock "refresh_cache-a4c8ae56-7de9-4b3f-be92-8940c0317c64" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:28:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:28:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lazy-loading 'flavor' on Instance uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:40 user nova-compute[75073]: INFO nova.compute.manager [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Attaching volume f5330268-9b7b-4fb9-800d-5f154e525756 to /dev/vdb
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.utils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c22140-0dd5-4142-9ad5-d4169485b51c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[61629dee-1fdc-4f63-8f5a-09528bd3c393]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf58aa-4b86-47a0-b98b-a08a99ee9aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f2918-bf54-432d-94d8-18a47fc0db64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:28:40 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65f8f6-2cf5-41fb-9bee-1782cd1657e6]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG os_brick.utils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating existing volume attachment record: 7232f6ff-af1d-42aa-badb-57e7403230f0 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:40 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:28:41 user nova-compute[75073]: INFO nova.compute.claims [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Claim successful on node user
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:28:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:28:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG nova.policy [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c5754304104fec9f1af3afc52e6f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99debe1b1a2443eba2f955911465f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:42 user nova-compute[75073]: INFO nova.virt.block_device [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Booting with blank volume at /dev/vda
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Successfully created port: 0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:28:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Successfully updated port: 0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-changed-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Refreshing instance network info cache due to event network-changed-0d77945a-d179-483b-933d-55586c31e2c5. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance network_info: |[{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Refreshing network info cache for port 0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updated VIF entry in instance network info cache for port 0d77945a-d179-483b-933d-55586c31e2c5. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.network.neutron [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f2858f33-2c33-40bb-b5ee-9e745fe97356 req-3697a555-998d-404e-af33-38354fb8ab3a service nova] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:28:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=25.477581024169922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 52a44464-e0d3-4620-9d54-37fd4d82d32c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:28:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfpBPHNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:28:47 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:28:47 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:28:47 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ece440-75ea-45d1-94b3-191ef19ce58b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:28:47 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fb2adb-60bb-4d46-a0c2-652973fc377b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756] added
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd78db6-37c7-42dc-8594-69e1cf811ab8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dbc461-ee02-4ef0-9b7c-2641608b3e94]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfpBPHNC {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfpBPHNC" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99639cf-efa2-4583-9540-6766153ad169]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vfpBPHNC'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a23c8-d6b9-4ff4-987a-243196f6b68d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09dc704-bd97-433c-a099-171a89ab32e3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed260f-5c57-40fa-abd2-cd6d66f83d9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260]
Nov 24 10:28:47 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260] successful.
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a00900-c844-4ef9-bd15-a309e1414332]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b8f06f-259d-479a-8eb4-72d7d6760eb0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58459c5-6218-46af-be93-472735ff3521]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfpBPHNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.utils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9b580-4e21-49f9-b0dd-abe8dbb37305]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f13f34c-5731-409f-9778-35b226854838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b521f77-d00a-4d22-b920-453564788fca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ab447-af63-4dc8-9414-039ed247a1a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:28:47 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:28:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07460842-6608-4c49-9334-5586ea3e65be]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG os_brick.utils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:28:47 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating existing volume attachment record: 70d541f6-e160-467c-aa2f-38eb010a5dad {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26532353932353135', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532353932353135', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.objects.instance [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lazy-loading 'flavor' on Instance uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:28:48 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:28:48 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:28:48 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:28:48 user nova-compute[75073]:   <serial>f5330268-9b7b-4fb9-800d-5f154e525756</serial>
Nov 24 10:28:48 user nova-compute[75073]: </disk>
Nov 24 10:28:48 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] No VIF found with MAC fa:16:3e:f9:5d:f9, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:28:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-942b4404-0c38-49a2-bd08-09dc2b0d07a8 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.699s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:51 user nova-compute[75073]: INFO nova.compute.manager [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Detaching volume f5330268-9b7b-4fb9-800d-5f154e525756
Nov 24 10:28:51 user nova-compute[75073]: INFO nova.virt.block_device [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Attempting to driver detach volume f5330268-9b7b-4fb9-800d-5f154e525756 from mountpoint /dev/vdb
Nov 24 10:28:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Attempting to detach device vdb from instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:28:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:28:51 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:28:51 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:28:51 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:28:51 user nova-compute[75073]:   <serial>f5330268-9b7b-4fb9-800d-5f154e525756</serial>
Nov 24 10:28:51 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:28:51 user nova-compute[75073]: </disk>
Nov 24 10:28:51 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:28:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Successfully detached device vdb from instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 from the persistent domain config.
Nov 24 10:28:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:28:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:28:51 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:28:51 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:28:51 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:28:51 user nova-compute[75073]:   <serial>f5330268-9b7b-4fb9-800d-5f154e525756</serial>
Nov 24 10:28:51 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:28:51 user nova-compute[75073]: </disk>
Nov 24 10:28:51 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:28:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:28:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Creating image(s)
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Ensure instance console log exists: /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start _get_guest_xml network_info=[{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '70d541f6-e160-467c-aa2f-38eb010a5dad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '838112bb-7408-44a0-82f7-8606ac3f0d86', 'attached_at': '', 'detached_at': '', 'volume_id': 'a645bb30-96b7-4149-a9c6-3d7c6286422a', 'serial': 'a645bb30-96b7-4149-a9c6-3d7c6286422a'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:28:54 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:54 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:28:54 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:28:54 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:28:54 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2948c-7751-40ca-854b-82690bd27251]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:28:54 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b562601f-9794-491f-8934-743ae71ddc39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a] added
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8d1c7-19ea-40fc-aa72-2699c8d889da]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51229b66-85d6-4170-bc7a-7d13397bc92d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTLgPjdl {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTLgPjdl" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[627c7471-6c64-438a-bb39-fd43656edb88]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTLgPjdl'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2772e5d-a506-4e71-951f-06a4b3cc077a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beee734-2658-4148-b3e2-658d22451daf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[37547104-a980-42be-9b47-50e01792a057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260]
Nov 24 10:28:55 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260] successful.
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae403b70-d095-4271-ba5d-43f6c5d58c36]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d113b0e-1c41-4f7b-a348-fb1e49ba32fa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:28:55 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:28:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec2417-f652-4fbd-a7bc-02fbf7849845]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:28:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23637383063356539', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383063356539', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533783566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533783566',id=20,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-f5opil4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:42Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=838112bb-7408-44a0-82f7-8606ac3f0d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:28:56 user nova-compute[75073]:   <uuid>838112bb-7408-44a0-82f7-8606ac3f0d86</uuid>
Nov 24 10:28:56 user nova-compute[75073]:   <name>instance-00000014</name>
Nov 24 10:28:56 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:28:56 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:28:56 user nova-compute[75073]:   <metadata>
Nov 24 10:28:56 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:28:56 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-533783566</nova:name>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:28:54</nova:creationTime>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:28:56 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:28:56 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:owner>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:28:56 user nova-compute[75073]:       </nova:owner>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:28:56 user nova-compute[75073]:       <nova:ports>
Nov 24 10:28:56 user nova-compute[75073]:         <nova:port uuid="0d77945a-d179-483b-933d-55586c31e2c5">
Nov 24 10:28:56 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:28:56 user nova-compute[75073]:         </nova:port>
Nov 24 10:28:56 user nova-compute[75073]:       </nova:ports>
Nov 24 10:28:56 user nova-compute[75073]:     </nova:instance>
Nov 24 10:28:56 user nova-compute[75073]:   </metadata>
Nov 24 10:28:56 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:28:56 user nova-compute[75073]:     <system>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="serial">838112bb-7408-44a0-82f7-8606ac3f0d86</entry>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="uuid">838112bb-7408-44a0-82f7-8606ac3f0d86</entry>
Nov 24 10:28:56 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:28:56 user nova-compute[75073]:     </system>
Nov 24 10:28:56 user nova-compute[75073]:   </sysinfo>
Nov 24 10:28:56 user nova-compute[75073]:   <os>
Nov 24 10:28:56 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:28:56 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:28:56 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:28:56 user nova-compute[75073]:   </os>
Nov 24 10:28:56 user nova-compute[75073]:   <features>
Nov 24 10:28:56 user nova-compute[75073]:     <acpi/>
Nov 24 10:28:56 user nova-compute[75073]:     <apic/>
Nov 24 10:28:56 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:28:56 user nova-compute[75073]:   </features>
Nov 24 10:28:56 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:28:56 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:28:56 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:28:56 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:28:56 user nova-compute[75073]:   </clock>
Nov 24 10:28:56 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:28:56 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:28:56 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:28:56 user nova-compute[75073]:   </cpu>
Nov 24 10:28:56 user nova-compute[75073]:   <devices>
Nov 24 10:28:56 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:28:56 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:28:56 user nova-compute[75073]:       <source dev="/dev/sdd"/>
Nov 24 10:28:56 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:28:56 user nova-compute[75073]:       <serial>a645bb30-96b7-4149-a9c6-3d7c6286422a</serial>
Nov 24 10:28:56 user nova-compute[75073]:     </disk>
Nov 24 10:28:56 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:28:56 user nova-compute[75073]:       <mac address="fa:16:3e:bd:10:67"/>
Nov 24 10:28:56 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:56 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:28:56 user nova-compute[75073]:       <target dev="tap0d77945a-d1"/>
Nov 24 10:28:56 user nova-compute[75073]:     </interface>
Nov 24 10:28:56 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:28:56 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/console.log" append="off"/>
Nov 24 10:28:56 user nova-compute[75073]:     </serial>
Nov 24 10:28:56 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:28:56 user nova-compute[75073]:     <video>
Nov 24 10:28:56 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:28:56 user nova-compute[75073]:     </video>
Nov 24 10:28:56 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:28:56 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:28:56 user nova-compute[75073]:     </rng>
Nov 24 10:28:56 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:28:56 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:28:56 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:28:56 user nova-compute[75073]:     </memballoon>
Nov 24 10:28:56 user nova-compute[75073]:   </devices>
Nov 24 10:28:56 user nova-compute[75073]: </domain>
Nov 24 10:28:56 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533783566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533783566',id=20,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-f5opil4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:28:42Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=838112bb-7408-44a0-82f7-8606ac3f0d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG os_vif [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2a207c6-fb55-5da0-9bb9-6b522807ed8e', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d77945a-d1, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d77945a-d1, col_values=(('qos', UUID('f75d9f51-0597-45e3-8959-2e803e9cf913')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d77945a-d1, col_values=(('external_ids', {'iface-id': '0d77945a-d179-483b-933d-55586c31e2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:10:67', 'vm-uuid': '838112bb-7408-44a0-82f7-8606ac3f0d86'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: INFO os_vif [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1')
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:bd:10:67, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:28:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:28:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:28:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:28:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:28:58 user nova-compute[75073]: WARNING nova.compute.manager [req-9db7f0b0-202a-4730-8ec1-4b9679c8fa77 req-2735a18b-74bb-4248-9357-4177935e2c72 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state building and task_state spawning.
Nov 24 10:28:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:28:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:28:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:28:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance spawned successfully.
Nov 24 10:28:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:00 user nova-compute[75073]: INFO nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:00 user nova-compute[75073]: WARNING nova.compute.manager [req-a31fc8cd-cb13-444d-90c1-f8e3060446b5 req-1be43da7-2ab8-4f3e-9906-a5bfb3fb82d9 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state building and task_state spawning.
Nov 24 10:29:00 user nova-compute[75073]: INFO nova.compute.manager [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Took 18.83 seconds to build instance.
Nov 24 10:29:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1605afa3-9873-475a-972a-5978055be9a2 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.932s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:12 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 is timed out.
Nov 24 10:29:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Successfully detached device vdb from instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 from the live domain config.
Nov 24 10:29:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfpBPHNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:12 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c58a6b-c555-40ec-a2f2-8f2ee9a85c0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:29:12 user nova-compute[75073]: No targets found.
Nov 24 10:29:12 user nova-compute[75073]: iSNS:
Nov 24 10:29:12 user nova-compute[75073]: No targets found.
Nov 24 10:29:12 user nova-compute[75073]: STATIC:
Nov 24 10:29:12 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11
Nov 24 10:29:12 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:12 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:12 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:29:12 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:12 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:12 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756
Nov 24 10:29:12 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:12 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:12 user nova-compute[75073]: FIRMWARE:
Nov 24 10:29:12 user nova-compute[75073]: No targets found.
Nov 24 10:29:12 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:29:12 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:29:12 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e5acd-2318-477c-b927-8247af90ac52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b2d34-85c7-4fc8-8f68-949d6fd0e362]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:29:12 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:29:12 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:12 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:29:12 user nova-compute[75073]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 (non-flash)
Nov 24 10:29:12 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:12 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23812c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de842513-d98a-4732-9518-8e65c89f22c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fa182-e442-47cc-887b-1af91f81d01b]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac5208-f887-4315-8a5c-5dd301238f5f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d5ab60-ad2e-44d8-b0fb-1cd6d1be5035]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aff9a2-3255-4263-bbd0-3a757b861c21]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622f957-f626-4c47-8138-9fd317954ab7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260]
Nov 24 10:29:12 user nova-compute[75073]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:12 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5330268-9b7b-4fb9-800d-5f154e525756 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd51d10-4e79-49df-bcc7-cfead0dc92c2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] <== disconnect_volume: return (293ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:29:13 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lazy-loading 'flavor' on Instance uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1751bf50-c686-4b91-8278-3b9a0ad59253 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing instance network info cache due to event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updated VIF entry in instance network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-14cfe31b-1e93-4b9d-ae57-83b939bec24f req-99744e37-62ae-4b8f-a8d6-7b00930fc739 service nova] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:15 user nova-compute[75073]: INFO nova.compute.manager [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Shelve offloading
Nov 24 10:29:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance destroyed successfully.
Nov 24 10:29:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:17 user nova-compute[75073]: WARNING nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state active and task_state shelving.
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:17 user nova-compute[75073]: WARNING nova.compute.manager [req-ab6ef9b3-847f-4a51-8d27-5739767c828f req-9c85a629-6ec3-4748-8ea8-d936d750f142 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state active and task_state shelving.
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:29:17 user nova-compute[75073]: INFO nova.compute.claims [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Claim successful on node user
Nov 24 10:29:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance destroyed successfully.
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.objects.instance [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'resources' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE0vzlQS+Ale4pn8cmHkdIcvb1/JfNkNZ/l7sHvPhTj+Id+QbzA44ZQgdp01+47H5RXzUGimXjG/DzdIpo0bymFfa5cc82Jty0t8iiRxUlBzyYpvKbKPmnB02mGogsj0Q==',key_name='tempest-TestShelveInstance-2012259995',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:27:36Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_vif [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb31cc3bf-c0, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1333669-6d35-42c1-b37b-a0b7607db30a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:17 user nova-compute[75073]: INFO os_vif [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0')
Nov 24 10:29:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c1216-3dc7-4587-b9f6-c20edb85f00a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:29:17 user nova-compute[75073]: No targets found.
Nov 24 10:29:17 user nova-compute[75073]: iSNS:
Nov 24 10:29:17 user nova-compute[75073]: No targets found.
Nov 24 10:29:17 user nova-compute[75073]: STATIC:
Nov 24 10:29:17 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11
Nov 24 10:29:17 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:17 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:17 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:29:17 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:17 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:17 user nova-compute[75073]: FIRMWARE:
Nov 24 10:29:17 user nova-compute[75073]: No targets found.
Nov 24 10:29:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:29:17 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:29:17 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adfd685-5c44-4582-a4d0-3d5178fafdce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9702a1-7b21-4abf-8714-3fd8e2c3d1b3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:29:17 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:29:17 user nova-compute[75073]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238203c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bac1f9-6de6-40c8-9815-7454e19092e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896f308-9c0a-47b2-835f-15946d9739e5]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37622f8-39f0-43f8-9d6e-7e2084bf0199]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf9d96-dfb4-49e7-99a7-88031be6ad81]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ba2bca-60d8-45e5-a61c-100016d19d78]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce5ba40-ea23-4542-b599-ec7d46c1d271]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]
Nov 24 10:29:18 user nova-compute[75073]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0dfc4-9d25-4738-8d50-94404c61c920]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== disconnect_volume: return (306ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:29:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deleting instance files /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3_del
Nov 24 10:29:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deletion of /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3_del complete
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:29:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.policy [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22b4e168f7a8473d8664e9225c867318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d3f3f3d5494608acae0f64a9bf8e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:29:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Creating image(s)
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.235s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Successfully created port: 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk 1073741824" returned: 0 in 0.049s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:19 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Deleted allocations for instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Cannot resize image /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Ensure instance console log exists: /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'numa_topology' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.objects.base [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Object Instance<26bb2d27-81da-4ef6-a631-39ee7edd35c3> lazy-loaded attributes: resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing instance network info cache due to event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Successfully updated port: 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2a936268-1cc3-4d3a-945d-41b7e0047370 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.768s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updated VIF entry in instance network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": null, "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fb1f114-dfd4-44fb-9093-a124c5156524 req-f0c70e09-d0ab-49c8-993b-6b7fd84fdeda service nova] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance network_info: |[{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start _get_guest_xml network_info=[{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:29:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-914988472',display_name='tempest-ServerRescueNegativeTestJSON-server-914988472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-914988472',id=21,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU72AqiwNWowUgJcgIp0J+/V8VwS3rD/PPSivhlQ6EukvovdepRuIFcaTtCMaL6JZxZlfdD8/RELh7/+lx8qCKeVcqU1xsuRD5EskX2ALCNxc4A/AnVqmyenHV/HZ3HXw==',key_name='tempest-keypair-1322066976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-7ck7xo3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b4e168f7a8473d8664e9225c867318',uuid=c5d379dd-cc6c-41f0-b5e7-bc576129943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:29:19 user nova-compute[75073]:   <uuid>c5d379dd-cc6c-41f0-b5e7-bc576129943a</uuid>
Nov 24 10:29:19 user nova-compute[75073]:   <name>instance-00000015</name>
Nov 24 10:29:19 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:29:19 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:29:19 user nova-compute[75073]:   <metadata>
Nov 24 10:29:19 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:29:19 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-914988472</nova:name>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:29:19</nova:creationTime>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:29:19 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:29:19 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:owner>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:29:19 user nova-compute[75073]:       </nova:owner>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:29:19 user nova-compute[75073]:       <nova:ports>
Nov 24 10:29:19 user nova-compute[75073]:         <nova:port uuid="788218bb-1988-4aed-95a1-b144fa414dc0">
Nov 24 10:29:19 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:29:19 user nova-compute[75073]:         </nova:port>
Nov 24 10:29:19 user nova-compute[75073]:       </nova:ports>
Nov 24 10:29:19 user nova-compute[75073]:     </nova:instance>
Nov 24 10:29:19 user nova-compute[75073]:   </metadata>
Nov 24 10:29:19 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:29:19 user nova-compute[75073]:     <system>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="serial">c5d379dd-cc6c-41f0-b5e7-bc576129943a</entry>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="uuid">c5d379dd-cc6c-41f0-b5e7-bc576129943a</entry>
Nov 24 10:29:19 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:29:19 user nova-compute[75073]:     </system>
Nov 24 10:29:19 user nova-compute[75073]:   </sysinfo>
Nov 24 10:29:19 user nova-compute[75073]:   <os>
Nov 24 10:29:19 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:29:19 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:29:19 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:29:19 user nova-compute[75073]:   </os>
Nov 24 10:29:19 user nova-compute[75073]:   <features>
Nov 24 10:29:19 user nova-compute[75073]:     <acpi/>
Nov 24 10:29:19 user nova-compute[75073]:     <apic/>
Nov 24 10:29:19 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:29:19 user nova-compute[75073]:   </features>
Nov 24 10:29:19 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:29:19 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:29:19 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:29:19 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:29:19 user nova-compute[75073]:   </clock>
Nov 24 10:29:19 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:29:19 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:29:19 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:29:19 user nova-compute[75073]:   </cpu>
Nov 24 10:29:19 user nova-compute[75073]:   <devices>
Nov 24 10:29:19 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:29:19 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:29:19 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk"/>
Nov 24 10:29:19 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:29:19 user nova-compute[75073]:     </disk>
Nov 24 10:29:19 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:29:19 user nova-compute[75073]:       <mac address="fa:16:3e:24:44:b9"/>
Nov 24 10:29:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:29:19 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:29:19 user nova-compute[75073]:       <target dev="tap788218bb-19"/>
Nov 24 10:29:19 user nova-compute[75073]:     </interface>
Nov 24 10:29:19 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:29:19 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/console.log" append="off"/>
Nov 24 10:29:19 user nova-compute[75073]:     </serial>
Nov 24 10:29:19 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:29:19 user nova-compute[75073]:     <video>
Nov 24 10:29:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:29:19 user nova-compute[75073]:     </video>
Nov 24 10:29:19 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:29:19 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:29:19 user nova-compute[75073]:     </rng>
Nov 24 10:29:19 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:29:19 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:29:19 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:29:19 user nova-compute[75073]:     </memballoon>
Nov 24 10:29:19 user nova-compute[75073]:   </devices>
Nov 24 10:29:19 user nova-compute[75073]: </domain>
Nov 24 10:29:19 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-914988472',display_name='tempest-ServerRescueNegativeTestJSON-server-914988472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-914988472',id=21,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU72AqiwNWowUgJcgIp0J+/V8VwS3rD/PPSivhlQ6EukvovdepRuIFcaTtCMaL6JZxZlfdD8/RELh7/+lx8qCKeVcqU1xsuRD5EskX2ALCNxc4A/AnVqmyenHV/HZ3HXw==',key_name='tempest-keypair-1322066976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-7ck7xo3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b4e168f7a8473d8664e9225c867318',uuid=c5d379dd-cc6c-41f0-b5e7-bc576129943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG os_vif [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a39677a6-c8ad-5dc3-bdea-0dc65be264ba', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap788218bb-19, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap788218bb-19, col_values=(('qos', UUID('6718c356-9211-43d9-aca9-c9b8a51acfdf')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap788218bb-19, col_values=(('external_ids', {'iface-id': '788218bb-1988-4aed-95a1-b144fa414dc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:44:b9', 'vm-uuid': 'c5d379dd-cc6c-41f0-b5e7-bc576129943a'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:19 user nova-compute[75073]: INFO os_vif [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19')
Nov 24 10:29:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:29:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:24:44:b9, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing instance network info cache due to event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updated VIF entry in instance network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:29:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0dcc2c47-1e49-4cc2-bc53-7dd6bf3a14f5 req-29963578-794f-4341-ac91-08382e213d81 service nova] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:29:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance spawned successfully.
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:23 user nova-compute[75073]: WARNING nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state building and task_state spawning.
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:23 user nova-compute[75073]: WARNING nova.compute.manager [req-40044b9a-8d39-47dc-8327-e5f0852c5d1f req-096bacae-0108-4cad-87df-331892706e9f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state building and task_state spawning.
Nov 24 10:29:23 user nova-compute[75073]: INFO nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 24 10:29:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:29:23 user nova-compute[75073]: INFO nova.compute.manager [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Took 6.02 seconds to build instance.
Nov 24 10:29:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a9fee0c6-8e51-4638-9b4e-f4a635d99341 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.153s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'flavor' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:34 user nova-compute[75073]: INFO nova.compute.manager [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Attaching volume 37ce071a-87ca-4e08-aade-46e7e26fd53a to /dev/vdb
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.utils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3603fc1-2757-457f-93ca-dd486c227265]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6484e203-ff99-47a5-8ee1-1e62dd51ff5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ddb8a-726c-4a2f-b10e-466188054db0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309def9-1beb-4c5f-8b80-19fc3ea4e4be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:34 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:29:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243f03b-b85d-461c-8846-5e1fd8bcca1b]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG os_brick.utils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating existing volume attachment record: 5d897ee4-dffa-4f57-a0e0-1a1f538ebaf3 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:29:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:29:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:40 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:40 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:40 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ad4b2-6c19-438a-a55b-f2d245de0773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:29:40 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e8565-35cb-4523-8a93-cd70e8c7ca0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added
Nov 24 10:29:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843a954-8d91-4692-bff3-bd6b5ddab13d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356beb5-af7f-4baa-8517-9b8e9c5d6760]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1655f5-a2fb-4747-90c5-0e753374a059]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnKwdRpj'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.095s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc99121-2f47-4ffa-85e7-839b0acda832]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee36ba1-e9ac-4ba2-89c5-eff10d6641d7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e470cf-18a7-4f5f-a4e7-4e15acb114c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:29:41 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868e787-f3bf-4082-9127-4aadd1d19252]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf773a4a-5dcf-4d07-a31e-37e1d3d7674f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c878caf-551a-44b4-a03c-5cd9331d3e5f]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'flavor' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:29:42 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:29:42 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:29:42 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:29:42 user nova-compute[75073]:   <serial>37ce071a-87ca-4e08-aade-46e7e26fd53a</serial>
Nov 24 10:29:42 user nova-compute[75073]: </disk>
Nov 24 10:29:42 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No VIF found with MAC fa:16:3e:74:2d:dc, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d4510ebd-df6f-4486-8608-2b7e47245f4b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.171s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:29:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Stashing vm_state: active {{(pid=75073) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:45 user nova-compute[75073]: INFO nova.compute.manager [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Terminating instance
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:29:45 user nova-compute[75073]: INFO nova.compute.claims [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Claim successful on node user
Nov 24 10:29:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:45 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating resource usage from migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b
Nov 24 10:29:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-unplugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] No waiting events found dispatching network-vif-unplugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-5959f6f3-d7ef-4e42-a647-9c9a4f9c4368 req-89981bb8-4d33-4d7a-85cb-f0569afacb39 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-unplugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:29:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=25.43648910522461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Instance destroyed successfully.
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lazy-loading 'resources' on Instance uuid a4c8ae56-7de9-4b3f-be92-8940c0317c64 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:26:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1695566074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1695566',id=16,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU7+A+MmVIN1F1dLIkSmJ9cFgMnifyUZxjsTa4EwOSABubkRUzMAHbdbSadn9K1XZRE/cSNVin+05hZziDafi54vel3eRTF9wb7Uuw5irOYq8DnIKcvwt3SPx7bfDgy5w==',key_name='tempest-keypair-1873303210',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0940e25f15c427dbd88ded078b9dbe3',ramdisk_id='',reservation_id='r-bg0mapux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='552125f8439c48fca5668206916d510e',uuid=a4c8ae56-7de9-4b3f-be92-8940c0317c64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converting VIF {"id": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "address": "fa:16:3e:f9:5d:f9", "network": {"id": "f479b612-aad6-4826-bf3b-03c6f5be8cf8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2101635198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0940e25f15c427dbd88ded078b9dbe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581149aa-d5", "ovs_interfaceid": "581149aa-d556-4a33-9ed6-78cb8f0ae528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG os_vif [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap581149aa-d5, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c68372d1-5bcd-4e17-8ccc-cefcfe3a0100) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:46 user nova-compute[75073]: INFO os_vif [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:5d:f9,bridge_name='br-int',has_traffic_filtering=True,id=581149aa-d556-4a33-9ed6-78cb8f0ae528,network=Network(f479b612-aad6-4826-bf3b-03c6f5be8cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581149aa-d5')
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Deleting instance files /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64_del
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Deletion of /opt/stack/data/nova/instances/a4c8ae56-7de9-4b3f-be92-8940c0317c64_del complete
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.compute.manager [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.402s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.compute.manager [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Migrating
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.298s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.compute.rpcapi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.network.neutron [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Applying migration context for instance 6352329f-a8ce-4008-b736-737934dd1b52 as it has an incoming, in-progress migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b. Migration status is pre-migrating {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 10:29:46 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating resource usage from migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 52a44464-e0d3-4620-9d54-37fd4d82d32c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:29:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Starting migrate_disk_and_power_off {{(pid=75073) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] Acquiring lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] No waiting events found dispatching network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:47 user nova-compute[75073]: WARNING nova.compute.manager [req-c93c03e3-d95b-433f-a083-43c75f0ddde1 req-97e38c2c-853b-4239-bee6-94f711694d47 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received unexpected event network-vif-plugged-581149aa-d556-4a33-9ed6-78cb8f0ae528 for instance with vm_state active and task_state deleting.
Nov 24 10:29:47 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Took 1.06 seconds to deallocate network for instance.
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1b911c8-2d6d-4af2-95b6-e8c8ca1d5368 req-57ab2a30-88c9-44fa-90ca-8b2627746192 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Received event network-vif-deleted-581149aa-d556-4a33-9ed6-78cb8f0ae528 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:47 user nova-compute[75073]: INFO nova.compute.manager [req-f1b911c8-2d6d-4af2-95b6-e8c8ca1d5368 req-57ab2a30-88c9-44fa-90ca-8b2627746192 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Neutron deleted interface 581149aa-d556-4a33-9ed6-78cb8f0ae528; detaching it from the instance and deleting it from the info cache
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.network.neutron [req-f1b911c8-2d6d-4af2-95b6-e8c8ca1d5368 req-57ab2a30-88c9-44fa-90ca-8b2627746192 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1b911c8-2d6d-4af2-95b6-e8c8ca1d5368 req-57ab2a30-88c9-44fa-90ca-8b2627746192 service nova] [instance: a4c8ae56-7de9-4b3f-be92-8940c0317c64] Detach interface failed, port_id=581149aa-d556-4a33-9ed6-78cb8f0ae528, reason: Instance a4c8ae56-7de9-4b3f-be92-8940c0317c64 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:48 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Deleted allocations for instance a4c8ae56-7de9-4b3f-be92-8940c0317c64
Nov 24 10:29:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance destroyed successfully.
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2345385d-d9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5b0da62-8e7e-4230-b090-725b682e5b10) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:48 user nova-compute[75073]: INFO os_vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:48 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8047a25-e161-4817-bb0b-43f4ac827e1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:29:48 user nova-compute[75073]: No targets found.
Nov 24 10:29:48 user nova-compute[75073]: iSNS:
Nov 24 10:29:48 user nova-compute[75073]: No targets found.
Nov 24 10:29:48 user nova-compute[75073]: STATIC:
Nov 24 10:29:48 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:29:48 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:48 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:48 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:29:48 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:29:48 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:29:48 user nova-compute[75073]: FIRMWARE:
Nov 24 10:29:48 user nova-compute[75073]: No targets found.
Nov 24 10:29:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:29:48 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:29:48 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c61a55-ea0a-4485-8861-53a3ca23b3ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a7badfd4-895c-4fa5-8f71-023469561a05 tempest-TestServerVolumeAttachScenarioOldVersion-857006206 tempest-TestServerVolumeAttachScenarioOldVersion-857006206-project-member] Lock "a4c8ae56-7de9-4b3f-be92-8940c0317c64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ffa86-205b-4497-988f-56f5fcac5194]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:48 user nova-compute[75073]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:48 user nova-compute[75073]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb24006e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[069fb4db-07ce-40f7-a18e-1280843d12e8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[870089f3-e31f-46ea-b314-1f561c76863a]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a922b514-a182-4337-910e-72f0a9899b40]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4757b-3a1c-408a-9582-7153b6a3b139]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c8a0e-c42f-4c0a-893e-48d794611b14]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[596b7d7b-7a3a-46fd-9d54-f77b15d75d9a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:29:48 user nova-compute[75073]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3abdd54-2fef-4dd4-87e8-faa5ed3ee7ae]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== disconnect_volume: return (305ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:29:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_resize/disk /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "cp -r /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_resize/disk /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk" returned: 0 in 0.439s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_resize/disk.info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk.info {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "cp -r /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_resize/disk.info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk.info" returned: 0 in 0.032s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:49 user nova-compute[75073]: WARNING nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state active and task_state resize_migrating.
Nov 24 10:29:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:29:49 user nova-compute[75073]: WARNING nova.compute.manager [req-74755b75-ad60-497c-911b-7795a43b55cc req-9451f898-7b52-4358-a5e8-224aca04156d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state active and task_state resize_migrating.
Nov 24 10:29:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Port 2345385d-d91c-4da6-b345-9216c98a05c2 binding to destination host user is already ACTIVE {{(pid=75073) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.utils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01e6b1-861e-48b4-89ae-0a1f207a003c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe6733-aced-4412-8483-cef99c208f74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5774ccd-f15b-448d-bf0f-a39092a0fc26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[817eef29-4c69-4efa-96fa-53713ac42d43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:51 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e2eae-4980-4f7d-a5f3-7fcd07068681]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG os_brick.utils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-changed-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Refreshing instance network info cache due to event network-changed-3553e048-612e-49d7-8cdb-6cf7a4107f5b. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] Acquiring lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] Acquired lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Refreshing network info cache for port 3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updated VIF entry in instance network info cache for port 3553e048-612e-49d7-8cdb-6cf7a4107f5b. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating instance_info_cache with network_info: [{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f6492ff6-3b8e-4326-b77d-ea2fd02b1ccf req-0359c2ff-ad85-46fd-9591-9fe2e01bb8a2 service nova] Releasing lock "refresh_cache-52a44464-e0d3-4620-9d54-37fd4d82d32c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'flavor' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:29:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:52 user nova-compute[75073]: INFO nova.compute.manager [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attaching volume 171e79c4-d22d-44f7-94e3-76b8301e10d8 to /dev/vdb
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.utils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce4fdb-2f21-4831-9654-e68c3e0677e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033d01f-bf98-426c-8d44-3d73b8801003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[223827f3-49f1-4269-b657-849fbd48f5e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe2c4e-9c0e-4ea7-a9c9-753b8b7ab8c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:29:52 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:29:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e80463-7fba-4bb9-80c2-e57232067b78]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG os_brick.utils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:52 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating existing volume attachment record: 36328e18-9038-412d-8e77-0516d129a3a7 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:29:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Starting finish_migration {{(pid=75073) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:29:57 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Creating image(s)
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk. size=21474836480 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk 21474836480 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk 21474836480" returned: 0 in 0.120s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Ensure instance console log exists: /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start _get_guest_xml network_info=[{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'bdc9109e-a4f7-4d5d-a63c-3e98541ace90', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6352329f-a8ce-4008-b736-737934dd1b52', 'attached_at': '2023-11-24T10:29:57.000000', 'detached_at': '', 'volume_id': '37ce071a-87ca-4e08-aade-46e7e26fd53a', 'serial': '37ce071a-87ca-4e08-aade-46e7e26fd53a'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:29:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:57 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:57 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:57 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ce770a-277f-4a66-99a7-1ecefb8b890c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:29:57 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be09bf3d-a50e-4ebd-b7da-700695cb9ce9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added
Nov 24 10:29:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b0b4d3-3d0f-428f-b8e5-ac74376057c7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635ec76-7b59-49fd-8d5b-609b260b6248]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2163dfe4-bca3-4cc5-8659-f63c50160584]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnKwdRpj'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d3370-a8e7-4b8d-a771-26f9ca586d0d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[34818df0-7014-4ecc-b5ed-4f51a0a5da03]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f38c44-4142-42b7-982e-c8ad69de279f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:29:58 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e246e-a498-4e40-8655-6edc4ed4ecb2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc1929-43e4-430a-915a-cc6e011e8120]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473bc58-7b9a-4178-bc3d-0f3b175c10f6]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:29:58 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.898s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:59 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:29:59 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b26821-8120-420e-969f-86d816149917]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:29:59 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:29:59 user nova-compute[75073]:   <uuid>6352329f-a8ce-4008-b736-737934dd1b52</uuid>
Nov 24 10:29:59 user nova-compute[75073]:   <name>instance-0000000f</name>
Nov 24 10:29:59 user nova-compute[75073]:   <memory>2097152</memory>
Nov 24 10:29:59 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:29:59 user nova-compute[75073]:   <metadata>
Nov 24 10:29:59 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:29:59 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherB-server-1321166727</nova:name>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:29:57</nova:creationTime>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:flavor name="m1.small">
Nov 24 10:29:59 user nova-compute[75073]:         <nova:memory>2048</nova:memory>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:disk>20</nova:disk>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:29:59 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:owner>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:user uuid="42d05b01c17a48aa93bcd7a4078332d7">tempest-ServerActionsTestOtherB-1373511819-project-member</nova:user>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:project uuid="496d4b08c8784b6b8afeb105d7fef10f">tempest-ServerActionsTestOtherB-1373511819</nova:project>
Nov 24 10:29:59 user nova-compute[75073]:       </nova:owner>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:29:59 user nova-compute[75073]:       <nova:ports>
Nov 24 10:29:59 user nova-compute[75073]:         <nova:port uuid="2345385d-d91c-4da6-b345-9216c98a05c2">
Nov 24 10:29:59 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:29:59 user nova-compute[75073]:         </nova:port>
Nov 24 10:29:59 user nova-compute[75073]:       </nova:ports>
Nov 24 10:29:59 user nova-compute[75073]:     </nova:instance>
Nov 24 10:29:59 user nova-compute[75073]:   </metadata>
Nov 24 10:29:59 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:29:59 user nova-compute[75073]:     <system>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="serial">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="uuid">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:29:59 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:29:59 user nova-compute[75073]:     </system>
Nov 24 10:29:59 user nova-compute[75073]:   </sysinfo>
Nov 24 10:29:59 user nova-compute[75073]:   <os>
Nov 24 10:29:59 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:29:59 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:29:59 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:29:59 user nova-compute[75073]:   </os>
Nov 24 10:29:59 user nova-compute[75073]:   <features>
Nov 24 10:29:59 user nova-compute[75073]:     <acpi/>
Nov 24 10:29:59 user nova-compute[75073]:     <apic/>
Nov 24 10:29:59 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:29:59 user nova-compute[75073]:   </features>
Nov 24 10:29:59 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:29:59 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:29:59 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:29:59 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:29:59 user nova-compute[75073]:   </clock>
Nov 24 10:29:59 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:29:59 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:29:59 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:29:59 user nova-compute[75073]:   </cpu>
Nov 24 10:29:59 user nova-compute[75073]:   <devices>
Nov 24 10:29:59 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:29:59 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:29:59 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk"/>
Nov 24 10:29:59 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:29:59 user nova-compute[75073]:     </disk>
Nov 24 10:29:59 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:29:59 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:29:59 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:29:59 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:29:59 user nova-compute[75073]:       <serial>37ce071a-87ca-4e08-aade-46e7e26fd53a</serial>
Nov 24 10:29:59 user nova-compute[75073]:     </disk>
Nov 24 10:29:59 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:29:59 user nova-compute[75073]:       <mac address="fa:16:3e:74:2d:dc"/>
Nov 24 10:29:59 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:29:59 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:29:59 user nova-compute[75073]:       <target dev="tap2345385d-d9"/>
Nov 24 10:29:59 user nova-compute[75073]:     </interface>
Nov 24 10:29:59 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:29:59 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/console.log" append="off"/>
Nov 24 10:29:59 user nova-compute[75073]:     </serial>
Nov 24 10:29:59 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:29:59 user nova-compute[75073]:     <video>
Nov 24 10:29:59 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:29:59 user nova-compute[75073]:     </video>
Nov 24 10:29:59 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:29:59 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:29:59 user nova-compute[75073]:     </rng>
Nov 24 10:29:59 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:29:59 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:29:59 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:29:59 user nova-compute[75073]:     </memballoon>
Nov 24 10:29:59 user nova-compute[75073]:   </devices>
Nov 24 10:29:59 user nova-compute[75073]: </domain>
Nov 24 10:29:59 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-250568375-network", "vif_mac": "fa:16:3e:74:2d:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11de25-8a29-4b1b-8a04-ae36f56d807c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edbb0dc6-8255-571b-9ae8-a415c2788676', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8] added
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2345385d-d9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2345385d-d9, col_values=(('qos', UUID('921b7619-dff1-4f92-8a32-e596674cb708')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2345385d-d9, col_values=(('external_ids', {'iface-id': '2345385d-d91c-4da6-b345-9216c98a05c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:2d:dc', 'vm-uuid': '6352329f-a8ce-4008-b736-737934dd1b52'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c0818-1b1a-4d4c-99e2-0962076e4447]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:29:59 user nova-compute[75073]: INFO os_vif [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9482d1-c6ac-4190-9140-254c8c6172d2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmudvhKC {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmudvhKC" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee63945-1dee-4be4-b498-850204e818f2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmudvhKC'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db8f80-fe59-4cc3-946f-258011b7f923]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] No VIF found with MAC fa:16:3e:74:2d:dc, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29d175-eff6-4f44-b10a-aabe13440a1f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420ae5f-6518-40f1-9338-ea3ec4eddde3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]
Nov 24 10:29:59 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9057001-6ded-4b4d-b269-e29771ccb8c7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d51dae-e82f-4e91-89d0-0b47f4089af9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:29:59 user nova-compute[75073]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:29:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d02206-0668-4def-8963-9fc2559e209d]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:29:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== connect_volume: return (2193ms) {'type': 'block', 'scsi_wwn': '26264323865613462', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323865613462', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG nova.objects.instance [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'flavor' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:30:00 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:30:00 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:30:00 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:30:00 user nova-compute[75073]:   <serial>171e79c4-d22d-44f7-94e3-76b8301e10d8</serial>
Nov 24 10:30:00 user nova-compute[75073]: </disk>
Nov 24 10:30:00 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:00 user nova-compute[75073]: WARNING nova.compute.manager [req-e85afbf7-40d7-4c89-9c73-070fa5ebab75 req-7f4cc397-9581-4305-ac08-e7d9a6ccdfad service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state active and task_state resize_finish.
Nov 24 10:30:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:8d:d9:5a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-002ef151-0e42-4a23-8599-9238c5abc039 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.930s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:02 user nova-compute[75073]: INFO nova.compute.manager [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Rebuilding instance
Nov 24 10:30:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:30:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance running successfully.
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:03 user nova-compute[75073]: WARNING nova.compute.manager [req-710ac4b9-844a-4b21-a95e-9723c626aab2 req-1a3455c9-322f-44a5-9436-6b65aacca3c3 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state active and task_state resize_finish.
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Failed to set time: agent not configured {{(pid=75073) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-36b752fc-66a9-441b-b06e-2cc046e38a96 tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] finish_migration finished successfully. {{(pid=75073) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance destroyed successfully.
Nov 24 10:30:03 user nova-compute[75073]: INFO nova.compute.manager [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Detaching volume 171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:30:03 user nova-compute[75073]: INFO nova.virt.block_device [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attempting to driver detach volume 171e79c4-d22d-44f7-94e3-76b8301e10d8 from mountpoint /dev/vdb
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Attempting to detach device vdb from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:30:03 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:30:03 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:30:03 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:30:03 user nova-compute[75073]:   <serial>171e79c4-d22d-44f7-94e3-76b8301e10d8</serial>
Nov 24 10:30:03 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:30:03 user nova-compute[75073]: </disk>
Nov 24 10:30:03 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:30:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully detached device vdb from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the persistent domain config.
Nov 24 10:30:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:30:03 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[534ca5aa-09e4-4677-b801-352489a20f77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:30:03 user nova-compute[75073]: No targets found.
Nov 24 10:30:03 user nova-compute[75073]: iSNS:
Nov 24 10:30:03 user nova-compute[75073]: No targets found.
Nov 24 10:30:03 user nova-compute[75073]: STATIC:
Nov 24 10:30:03 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:30:03 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:30:03 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:30:03 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:30:03 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:30:03 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:30:03 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:30:03 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:30:03 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:30:03 user nova-compute[75073]: FIRMWARE:
Nov 24 10:30:03 user nova-compute[75073]: No targets found.
Nov 24 10:30:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:30:03 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:30:03 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c97e92-63c3-4946-8288-304362355aed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f73c7-498a-4849-802e-acce0ca8eb7e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:03 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:03 user nova-compute[75073]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:03 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:03 user nova-compute[75073]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23812fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d28b85-ffd3-46bc-bc8d-b5fef2083384]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6829d5-1684-4cd6-b518-dba5cbcec14b]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce204ca1-5a96-46d3-8525-e0038448b7ca]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e63d4a-0611-48c7-a66e-fdeb2f37aa35]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20996813-b579-46bc-a3ac-1e0e74eed2db]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c94ae1b-9d08-43f9-b0ac-7e0422a8a72f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]
Nov 24 10:30:04 user nova-compute[75073]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.
Nov 24 10:30:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971bde7-8284-499b-bc5f-400a6bab58f0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== disconnect_volume: return (316ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:30:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:05 user nova-compute[75073]: WARNING nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state active and task_state rebuilding.
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:05 user nova-compute[75073]: WARNING nova.compute.manager [req-a4eb5ccf-60b8-4c72-a393-62a5135a5db9 req-9c5b7114-521e-4280-9619-8ba8b1e1ff90 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state active and task_state rebuilding.
Nov 24 10:30:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance destroyed successfully.
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-ServerActionsTestOtherA-server-378441943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3553e048-61, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=726ae23a-0d87-4213-b36d-c143f37bcca4) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:05 user nova-compute[75073]: INFO os_vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61')
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:30:05 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e33639-afc7-43dd-85d4-13bbc7b65fad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:30:05 user nova-compute[75073]: No targets found.
Nov 24 10:30:05 user nova-compute[75073]: iSNS:
Nov 24 10:30:05 user nova-compute[75073]: No targets found.
Nov 24 10:30:05 user nova-compute[75073]: STATIC:
Nov 24 10:30:05 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:30:05 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:30:05 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:30:05 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:30:05 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:30:05 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:30:05 user nova-compute[75073]: FIRMWARE:
Nov 24 10:30:05 user nova-compute[75073]: No targets found.
Nov 24 10:30:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:30:05 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:30:05 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d9da1b-08d5-4fb5-982d-211306b455a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd6eb9c-4055-4f60-88fc-c784859dc42f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:05 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:05 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23878b010>, {}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Disconnecting from: [] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== disconnect_volume: return (66ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:30:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Deleting instance files /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c_del
Nov 24 10:30:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Deletion of /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c_del complete
Nov 24 10:30:05 user nova-compute[75073]: INFO nova.virt.block_device [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Booting with volume 171e79c4-d22d-44f7-94e3-76b8301e10d8 at /dev/vdb
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.utils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[74851f2a-c4a6-4921-8191-f3190f3ee6e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e871f-3c56-4674-b688-b1520880e389]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f3136-f1c7-4a8c-a878-f55ff342f46b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35a76a-b149-44a3-aaf6-ecd0fbda2a94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:30:05 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:30:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9203f29d-4eb4-4c45-a30f-fca63b9d8ab7]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG os_brick.utils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:05 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating existing volume attachment record: a1354050-de63-43cb-8140-66fa7d12ad09 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:30:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing instance network info cache due to event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updated VIF entry in instance network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:30:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a858fd13-83c2-42f9-a85e-486c9b897af9 req-b46407f5-faf6-42a1-a0c9-0d93eada6a64 service nova] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:30:09 user nova-compute[75073]: INFO nova.compute.manager [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] instance snapshotting
Nov 24 10:30:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Beginning live snapshot process
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573.delta 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573.delta 1073741824" returned: 0 in 0.048s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 10:30:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:30:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:30:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 10:30:11 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:30:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573.delta /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573.delta /opt/stack/data/nova/instances/snapshots/tmpd5tlz564/4dd578e5cbe548beb1a89a5eac56a573" returned: 0 in 0.327s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Snapshot extracted, beginning image upload
Nov 24 10:30:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:30:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Creating image(s)
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.203s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk 1073741824" returned: 0 in 0.061s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.207s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:30:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Cannot resize image /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Ensure instance console log exists: /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start _get_guest_xml network_info=[{"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a1354050-de63-43cb-8140-66fa7d12ad09', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52a44464-e0d3-4620-9d54-37fd4d82d32c', 'attached_at': '', 'detached_at': '', 'volume_id': '171e79c4-d22d-44f7-94e3-76b8301e10d8', 'serial': '171e79c4-d22d-44f7-94e3-76b8301e10d8'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:30:13 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 10:30:13 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:30:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:13 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f8597-0a9c-44d4-991b-464db434eeeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:30:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61445db-289b-4cbf-a3be-f55aae94ce24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8] added
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6260efd-245a-46d0-823c-03a8d7569277]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de909ed6-c34f-4207-9f7e-20a72676a1fe]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmudvhKC {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmudvhKC" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae3191-bfc3-41dd-be3f-0c3aa73e2420]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmudvhKC'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7cbb54-2c35-475e-8e4e-0a6d83334e82]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2dcce-c09c-4605-8622-a4dbabffe015]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab03a27-6d1a-45ff-8ed6-7945597e5c75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]
Nov 24 10:30:13 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d614f7-d096-45aa-8b5d-b64ed21ec548]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e411da4-2e1b-46ae-8f5a-8bbb60163640]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:13 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa5e31-1631-4685-8e5c-2b1f9b59f3cf]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26264323865613462', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323865613462', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-ServerActionsTestOtherA-server-378441943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:30:14 user nova-compute[75073]:   <uuid>52a44464-e0d3-4620-9d54-37fd4d82d32c</uuid>
Nov 24 10:30:14 user nova-compute[75073]:   <name>instance-00000012</name>
Nov 24 10:30:14 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:30:14 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:30:14 user nova-compute[75073]:   <metadata>
Nov 24 10:30:14 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:30:14 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherA-server-378441943</nova:name>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:30:13</nova:creationTime>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:30:14 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:30:14 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:owner>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:user uuid="dffd5f6353e344aa96a97235372632fd">tempest-ServerActionsTestOtherA-371935856-project-member</nova:user>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:project uuid="4665d407280c4667beadb1678e105480">tempest-ServerActionsTestOtherA-371935856</nova:project>
Nov 24 10:30:14 user nova-compute[75073]:       </nova:owner>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:30:14 user nova-compute[75073]:       <nova:ports>
Nov 24 10:30:14 user nova-compute[75073]:         <nova:port uuid="3553e048-612e-49d7-8cdb-6cf7a4107f5b">
Nov 24 10:30:14 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:30:14 user nova-compute[75073]:         </nova:port>
Nov 24 10:30:14 user nova-compute[75073]:       </nova:ports>
Nov 24 10:30:14 user nova-compute[75073]:     </nova:instance>
Nov 24 10:30:14 user nova-compute[75073]:   </metadata>
Nov 24 10:30:14 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:30:14 user nova-compute[75073]:     <system>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="serial">52a44464-e0d3-4620-9d54-37fd4d82d32c</entry>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="uuid">52a44464-e0d3-4620-9d54-37fd4d82d32c</entry>
Nov 24 10:30:14 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:30:14 user nova-compute[75073]:     </system>
Nov 24 10:30:14 user nova-compute[75073]:   </sysinfo>
Nov 24 10:30:14 user nova-compute[75073]:   <os>
Nov 24 10:30:14 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:30:14 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:30:14 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:30:14 user nova-compute[75073]:   </os>
Nov 24 10:30:14 user nova-compute[75073]:   <features>
Nov 24 10:30:14 user nova-compute[75073]:     <acpi/>
Nov 24 10:30:14 user nova-compute[75073]:     <apic/>
Nov 24 10:30:14 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:30:14 user nova-compute[75073]:   </features>
Nov 24 10:30:14 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:30:14 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:30:14 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:30:14 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:30:14 user nova-compute[75073]:   </clock>
Nov 24 10:30:14 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:30:14 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:30:14 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:30:14 user nova-compute[75073]:   </cpu>
Nov 24 10:30:14 user nova-compute[75073]:   <devices>
Nov 24 10:30:14 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:30:14 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:30:14 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk"/>
Nov 24 10:30:14 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:30:14 user nova-compute[75073]:     </disk>
Nov 24 10:30:14 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:30:14 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:30:14 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:30:14 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:30:14 user nova-compute[75073]:       <serial>171e79c4-d22d-44f7-94e3-76b8301e10d8</serial>
Nov 24 10:30:14 user nova-compute[75073]:     </disk>
Nov 24 10:30:14 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:30:14 user nova-compute[75073]:       <mac address="fa:16:3e:8d:d9:5a"/>
Nov 24 10:30:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:30:14 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:30:14 user nova-compute[75073]:       <target dev="tap3553e048-61"/>
Nov 24 10:30:14 user nova-compute[75073]:     </interface>
Nov 24 10:30:14 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:30:14 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/console.log" append="off"/>
Nov 24 10:30:14 user nova-compute[75073]:     </serial>
Nov 24 10:30:14 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:30:14 user nova-compute[75073]:     <video>
Nov 24 10:30:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:30:14 user nova-compute[75073]:     </video>
Nov 24 10:30:14 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:30:14 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:30:14 user nova-compute[75073]:     </rng>
Nov 24 10:30:14 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:30:14 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:30:14 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:30:14 user nova-compute[75073]:     </memballoon>
Nov 24 10:30:14 user nova-compute[75073]:   </devices>
Nov 24 10:30:14 user nova-compute[75073]: </domain>
Nov 24 10:30:14 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-ServerActionsTestOtherA-server-378441943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG os_vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd08a00f1-8e9b-56c9-a75b-a5401464e0a3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3553e048-61, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3553e048-61, col_values=(('qos', UUID('7551b9d4-d086-468e-b603-8f1fa7d27934')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3553e048-61, col_values=(('external_ids', {'iface-id': '3553e048-612e-49d7-8cdb-6cf7a4107f5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:d9:5a', 'vm-uuid': '52a44464-e0d3-4620-9d54-37fd4d82d32c'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:30:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Snapshot image upload complete
Nov 24 10:30:14 user nova-compute[75073]: INFO nova.compute.manager [None req-ab102630-d721-43c3-9172-1919f1869a2e tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:30:14 user nova-compute[75073]: INFO os_vif [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61')
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:8d:d9:5a, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:30:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:16 user nova-compute[75073]: WARNING nova.compute.manager [req-78d79b58-a006-46fc-8066-956fa8d2fa67 req-17d17366-8340-41fa-8f09-8d8edabb1631 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state active and task_state rebuild_spawning.
Nov 24 10:30:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:30:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance spawned successfully.
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75073) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:18 user nova-compute[75073]: WARNING nova.compute.manager [req-898418a3-2444-411e-b35a-79bd2c5c5b25 req-cf528197-e9e6-4e9b-b484-1e1e9ca046d8 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state active and task_state None.
Nov 24 10:30:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf19b2f-5e45-4db2-ac4d-896aeffd7c56 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:32 user nova-compute[75073]: INFO nova.compute.manager [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Rescuing
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:32 user nova-compute[75073]: WARNING nova.compute.manager [req-07d90dc2-a1e4-45bd-a4c5-b7a031bce200 req-94a3f1db-0485-49cd-a934-887736337aeb service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state active and task_state rescuing.
Nov 24 10:30:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance destroyed successfully.
Nov 24 10:30:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Attempting a stable device rescue
Nov 24 10:30:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:30:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Creating image(s)
Nov 24 10:30:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "6eb48bd884d42d907d54458744340d4ade110a90" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "6eb48bd884d42d907d54458744340d4ade110a90" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG nova.virt.images [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] e0f6b6de-7ecd-48a9-bbc7-67f069e30dc1 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:30:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.part /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.part /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.converted" returned: 0 in 0.319s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:35 user nova-compute[75073]: WARNING nova.compute.manager [req-2be01505-5851-4348-84b4-1a967df1cb72 req-57f658eb-b2c2-4f12-b1f3-a1a5326cad5e service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state active and task_state rescuing.
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "6eb48bd884d42d907d54458744340d4ade110a90" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.726s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "6eb48bd884d42d907d54458744340d4ade110a90" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "6eb48bd884d42d907d54458744340d4ade110a90" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90 --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90,backing_fmt=raw /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90,backing_fmt=raw /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue" returned: 0 in 0.050s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "6eb48bd884d42d907d54458744340d4ade110a90" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'migration_context' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<838112bb-7408-44a0-82f7-8606ac3f0d86> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start _get_guest_xml network_info=[{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:bd:10:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e0f6b6de-7ecd-48a9-bbc7-67f069e30dc1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '70d541f6-e160-467c-aa2f-38eb010a5dad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '838112bb-7408-44a0-82f7-8606ac3f0d86', 'attached_at': '', 'detached_at': '', 'volume_id': 'a645bb30-96b7-4149-a9c6-3d7c6286422a', 'serial': 'a645bb30-96b7-4149-a9c6-3d7c6286422a'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<838112bb-7408-44a0-82f7-8606ac3f0d86> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'numa_topology' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<838112bb-7408-44a0-82f7-8606ac3f0d86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:30:35 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:30:35 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<838112bb-7408-44a0-82f7-8606ac3f0d86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:30:35 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:35 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:30:35 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a5b5b-b88a-4665-9c52-f05d8c3e8abd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KTLgPjdl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 10:30:35 user nova-compute[75073]: node.name = iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:30:35 user nova-compute[75073]: node.tpgt = -1
Nov 24 10:30:35 user nova-compute[75073]: node.startup = automatic
Nov 24 10:30:35 user nova-compute[75073]: node.leading_login = No
Nov 24 10:30:35 user nova-compute[75073]: iface.iscsi_ifacename = default
Nov 24 10:30:35 user nova-compute[75073]: iface.net_ifacename = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.ipaddress = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.prefix_len = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.hwaddress = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.transport_name = tcp
Nov 24 10:30:35 user nova-compute[75073]: iface.initiatorname = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.vlan_id = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.vlan_priority = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.vlan_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.iface_num = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.mtu = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.port = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.bootproto = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.subnet_mask = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.gateway = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_alt_client_id = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_dns = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_learn_iqn = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_vendor_id_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_vendor_id = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.dhcp_slp_da = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.fragmentation = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.gratuitous_arp = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.incoming_forwarding = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.tos_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.tos = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.ttl = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.delayed_ack = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.tcp_nagle = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.tcp_wsf_state = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.tcp_wsf = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.tcp_timer_scale = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.tcp_timestamp = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.redirect = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.def_task_mgmt_timeout = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.header_digest = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.data_digest = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.immediate_data = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.initial_r2t = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.data_seq_inorder = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.data_pdu_inorder = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.erl = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.max_receive_data_len = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.first_burst_len = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.max_outstanding_r2t = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.max_burst_len = 0
Nov 24 10:30:35 user nova-compute[75073]: iface.chap_auth = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.bidi_chap = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.strict_login_compliance = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.discovery_auth = <empty>
Nov 24 10:30:35 user nova-compute[75073]: iface.discovery_logout = <empty>
Nov 24 10:30:35 user nova-compute[75073]: node.discovery_address = <empty>
Nov 24 10:30:35 user nova-compute[75073]: node.discovery_port = 0
Nov 24 10:30:35 user nova-compute[75073]: node.discovery_type = static
Nov 24 10:30:35 user nova-compute[75073]: node.session.initial_cmdsn = 0
Nov 24 10:30:35 user nova-compute[75073]: node.session.initial_login_retry_max = 8
Nov 24 10:30:35 user nova-compute[75073]: node.session.xmit_thread_priority = -20
Nov 24 10:30:35 user nova-compute[75073]: node.session.cmds_max = 128
Nov 24 10:30:35 user nova-compute[75073]: node.session.queue_depth = 32
Nov 24 10:30:35 user nova-compute[75073]: node.session.nr_sessions = 1
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.authmethod = CHAP
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.username = KTLgPjdl
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.password = ***
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.username_in = <empty>
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.password_in = <empty>
Nov 24 10:30:35 user nova-compute[75073]: node.session.auth.chap_algs = MD5
Nov 24 10:30:35 user nova-compute[75073]: node.session.timeo.replacement_timeout = 120
Nov 24 10:30:35 user nova-compute[75073]: node.session.err_timeo.abort_timeout = 15
Nov 24 10:30:35 user nova-compute[75073]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 10:30:35 user nova-compute[75073]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 10:30:35 user nova-compute[75073]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.FastAbort = Yes
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.InitialR2T = No
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.ImmediateData = Yes
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.MaxConnections = 1
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 10:30:35 user nova-compute[75073]: node.session.iscsi.ERL = 0
Nov 24 10:30:35 user nova-compute[75073]: node.session.scan = manual
Nov 24 10:30:35 user nova-compute[75073]: node.session.reopen_max = 0
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].address = 172.16.0.220
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].port = 3260
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].startup = manual
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].tcp.window_size = 524288
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].tcp.type_of_service = 0
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].timeo.logout_timeout = 15
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].timeo.login_timeout = 15
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].timeo.auth_timeout = 45
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.DataDigest = None
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.IFMarker = No
Nov 24 10:30:35 user nova-compute[75073]: node.conn[0].iscsi.OFMarker = No
Nov 24 10:30:35 user nova-compute[75073]: # END RECORD
Nov 24 10:30:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8be912-d3c7-4cf0-b1a8-5d510a24267f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29cd0c-1fe4-4a84-84e8-a5d2d37efe78]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTLgPjdl {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTLgPjdl" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e8106-6307-47ae-a6fd-a23f238699ce]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTLgPjdl'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaed70b-316b-4015-9833-e089bb97dbef]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d5d8a-7af0-4880-9c11-e266be820b48]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:35 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:35 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:30:35 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:30:35 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:30:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] HCTL ('35', '0', '0', 0) found on session 24 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda7f28-d1b6-4fc7-8bcb-a8aa29ce6315]: (4, ('0 0 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 24 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23637383063356539', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383063356539', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533783566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533783566',id=20,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-f5opil4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:00Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=838112bb-7408-44a0-82f7-8606ac3f0d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:bd:10:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:bd:10:67"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.objects.base [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<838112bb-7408-44a0-82f7-8606ac3f0d86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:30:35 user nova-compute[75073]:   <uuid>838112bb-7408-44a0-82f7-8606ac3f0d86</uuid>
Nov 24 10:30:35 user nova-compute[75073]:   <name>instance-00000014</name>
Nov 24 10:30:35 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:30:35 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:30:35 user nova-compute[75073]:   <metadata>
Nov 24 10:30:35 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:30:35 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-533783566</nova:name>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:30:35</nova:creationTime>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:30:35 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:30:35 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:owner>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:30:35 user nova-compute[75073]:       </nova:owner>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:30:35 user nova-compute[75073]:       <nova:ports>
Nov 24 10:30:35 user nova-compute[75073]:         <nova:port uuid="0d77945a-d179-483b-933d-55586c31e2c5">
Nov 24 10:30:35 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:30:35 user nova-compute[75073]:         </nova:port>
Nov 24 10:30:35 user nova-compute[75073]:       </nova:ports>
Nov 24 10:30:35 user nova-compute[75073]:     </nova:instance>
Nov 24 10:30:35 user nova-compute[75073]:   </metadata>
Nov 24 10:30:35 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:30:35 user nova-compute[75073]:     <system>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="serial">838112bb-7408-44a0-82f7-8606ac3f0d86</entry>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="uuid">838112bb-7408-44a0-82f7-8606ac3f0d86</entry>
Nov 24 10:30:35 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:30:35 user nova-compute[75073]:     </system>
Nov 24 10:30:35 user nova-compute[75073]:   </sysinfo>
Nov 24 10:30:35 user nova-compute[75073]:   <os>
Nov 24 10:30:35 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:30:35 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:30:35 user nova-compute[75073]:   </os>
Nov 24 10:30:35 user nova-compute[75073]:   <features>
Nov 24 10:30:35 user nova-compute[75073]:     <acpi/>
Nov 24 10:30:35 user nova-compute[75073]:     <apic/>
Nov 24 10:30:35 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:30:35 user nova-compute[75073]:   </features>
Nov 24 10:30:35 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:30:35 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:30:35 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:30:35 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:30:35 user nova-compute[75073]:   </clock>
Nov 24 10:30:35 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:30:35 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:30:35 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:30:35 user nova-compute[75073]:   </cpu>
Nov 24 10:30:35 user nova-compute[75073]:   <devices>
Nov 24 10:30:35 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:30:35 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:30:35 user nova-compute[75073]:       <source dev="/dev/sdd"/>
Nov 24 10:30:35 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:30:35 user nova-compute[75073]:       <serial>a645bb30-96b7-4149-a9c6-3d7c6286422a</serial>
Nov 24 10:30:35 user nova-compute[75073]:     </disk>
Nov 24 10:30:35 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:30:35 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:30:35 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue"/>
Nov 24 10:30:35 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:30:35 user nova-compute[75073]:       <boot order="1"/>
Nov 24 10:30:35 user nova-compute[75073]:     </disk>
Nov 24 10:30:35 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:30:35 user nova-compute[75073]:       <mac address="fa:16:3e:bd:10:67"/>
Nov 24 10:30:35 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:30:35 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:30:35 user nova-compute[75073]:       <target dev="tap0d77945a-d1"/>
Nov 24 10:30:35 user nova-compute[75073]:     </interface>
Nov 24 10:30:35 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:30:35 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/console.log" append="off"/>
Nov 24 10:30:35 user nova-compute[75073]:     </serial>
Nov 24 10:30:35 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:30:35 user nova-compute[75073]:     <video>
Nov 24 10:30:35 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:30:35 user nova-compute[75073]:     </video>
Nov 24 10:30:35 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:30:35 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:30:35 user nova-compute[75073]:     </rng>
Nov 24 10:30:35 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:30:35 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:30:35 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:30:35 user nova-compute[75073]:     </memballoon>
Nov 24 10:30:35 user nova-compute[75073]:   </devices>
Nov 24 10:30:35 user nova-compute[75073]: </domain>
Nov 24 10:30:35 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:30:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance destroyed successfully.
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:30:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:bd:10:67, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:30:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:37 user nova-compute[75073]: WARNING nova.compute.manager [req-78c74179-8be3-4998-a3d4-db4d71c85848 req-b4b8c079-9e5b-4133-bdcb-2a736f0a911f service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state active and task_state rescuing.
Nov 24 10:30:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:30:39 user nova-compute[75073]: WARNING nova.compute.manager [req-7d84d186-73be-41db-a9f8-ad986ed38c69 req-7085d96f-6bf1-4902-8136-cf5480637921 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state active and task_state rescuing.
Nov 24 10:30:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-02856ff8-bfaa-4f75-88e4-b53a2c0c22af tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:30:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:30:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:30:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7794MB free_disk=25.278797149658203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Applying migration context for instance 6352329f-a8ce-4008-b736-737934dd1b52 as it has an incoming, in-progress migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b. Migration status is finished {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 10:30:45 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating resource usage from migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 52a44464-e0d3-4620-9d54-37fd4d82d32c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:30:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:30:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:30:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:30:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:30:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:30:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:30:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:30:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:30:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:31:00 user nova-compute[75073]: INFO nova.compute.claims [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Claim successful on node user
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:31:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:31:00 user nova-compute[75073]: DEBUG nova.policy [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76623c68b4234fc3b4b1d7ceedd7044c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f6a908740a4a628e63485b71dc0e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:31:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Creating image(s)
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "/opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "/opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk 1073741824" returned: 0 in 0.046s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Successfully created port: 67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Cannot resize image /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Ensure instance console log exists: /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Successfully updated port: 67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquired lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-changed-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Refreshing instance network info cache due to event network-changed-67c860c4-a227-4aea-9577-af4e7d509c90. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] Acquiring lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating instance_info_cache with network_info: [{"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Releasing lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Instance network_info: |[{"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] Acquired lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.neutron [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Refreshing network info cache for port 67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Start _get_guest_xml network_info=[{"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:31:02 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:02 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-857652970',display_name='tempest-TestServerVolumeAttachmentScenario-server-857652970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-857652970',id=22,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgVrjcr5x8tC5X4WEB8HSXYYS/lEmAuBiTZZCRpRCOSmKJqlOXC72sQ7ANyfK0Eb7UYdWHKzC6w8nBHtN5POnn9ZdKCw6tfFE4GxopKI4D/8qWBvP/u3sqoYezYUhB7HQ==',key_name='tempest-keypair-680494624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f6a908740a4a628e63485b71dc0e50',ramdisk_id='',reservation_id='r-r8plopn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2121002479',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2121002479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76623c68b4234fc3b4b1d7ceedd7044c',uuid=8e2966a4-412c-4a3c-befd-31cfa17a77d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converting VIF {"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:31:02 user nova-compute[75073]:   <uuid>8e2966a4-412c-4a3c-befd-31cfa17a77d7</uuid>
Nov 24 10:31:02 user nova-compute[75073]:   <name>instance-00000016</name>
Nov 24 10:31:02 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:31:02 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:31:02 user nova-compute[75073]:   <metadata>
Nov 24 10:31:02 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:31:02 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-857652970</nova:name>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:31:02</nova:creationTime>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:31:02 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:31:02 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:owner>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:user uuid="76623c68b4234fc3b4b1d7ceedd7044c">tempest-TestServerVolumeAttachmentScenario-2121002479-project-member</nova:user>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:project uuid="b3f6a908740a4a628e63485b71dc0e50">tempest-TestServerVolumeAttachmentScenario-2121002479</nova:project>
Nov 24 10:31:02 user nova-compute[75073]:       </nova:owner>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:31:02 user nova-compute[75073]:       <nova:ports>
Nov 24 10:31:02 user nova-compute[75073]:         <nova:port uuid="67c860c4-a227-4aea-9577-af4e7d509c90">
Nov 24 10:31:02 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:31:02 user nova-compute[75073]:         </nova:port>
Nov 24 10:31:02 user nova-compute[75073]:       </nova:ports>
Nov 24 10:31:02 user nova-compute[75073]:     </nova:instance>
Nov 24 10:31:02 user nova-compute[75073]:   </metadata>
Nov 24 10:31:02 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:31:02 user nova-compute[75073]:     <system>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="serial">8e2966a4-412c-4a3c-befd-31cfa17a77d7</entry>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="uuid">8e2966a4-412c-4a3c-befd-31cfa17a77d7</entry>
Nov 24 10:31:02 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:31:02 user nova-compute[75073]:     </system>
Nov 24 10:31:02 user nova-compute[75073]:   </sysinfo>
Nov 24 10:31:02 user nova-compute[75073]:   <os>
Nov 24 10:31:02 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:31:02 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:31:02 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:31:02 user nova-compute[75073]:   </os>
Nov 24 10:31:02 user nova-compute[75073]:   <features>
Nov 24 10:31:02 user nova-compute[75073]:     <acpi/>
Nov 24 10:31:02 user nova-compute[75073]:     <apic/>
Nov 24 10:31:02 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:31:02 user nova-compute[75073]:   </features>
Nov 24 10:31:02 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:31:02 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:31:02 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:31:02 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:31:02 user nova-compute[75073]:   </clock>
Nov 24 10:31:02 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:31:02 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:31:02 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:31:02 user nova-compute[75073]:   </cpu>
Nov 24 10:31:02 user nova-compute[75073]:   <devices>
Nov 24 10:31:02 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:31:02 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:31:02 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk"/>
Nov 24 10:31:02 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:31:02 user nova-compute[75073]:     </disk>
Nov 24 10:31:02 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:31:02 user nova-compute[75073]:       <mac address="fa:16:3e:5f:26:d6"/>
Nov 24 10:31:02 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:02 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:31:02 user nova-compute[75073]:       <target dev="tap67c860c4-a2"/>
Nov 24 10:31:02 user nova-compute[75073]:     </interface>
Nov 24 10:31:02 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:31:02 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/console.log" append="off"/>
Nov 24 10:31:02 user nova-compute[75073]:     </serial>
Nov 24 10:31:02 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:31:02 user nova-compute[75073]:     <video>
Nov 24 10:31:02 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:02 user nova-compute[75073]:     </video>
Nov 24 10:31:02 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:31:02 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:31:02 user nova-compute[75073]:     </rng>
Nov 24 10:31:02 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:31:02 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:31:02 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:31:02 user nova-compute[75073]:     </memballoon>
Nov 24 10:31:02 user nova-compute[75073]:   </devices>
Nov 24 10:31:02 user nova-compute[75073]: </domain>
Nov 24 10:31:02 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-857652970',display_name='tempest-TestServerVolumeAttachmentScenario-server-857652970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-857652970',id=22,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgVrjcr5x8tC5X4WEB8HSXYYS/lEmAuBiTZZCRpRCOSmKJqlOXC72sQ7ANyfK0Eb7UYdWHKzC6w8nBHtN5POnn9ZdKCw6tfFE4GxopKI4D/8qWBvP/u3sqoYezYUhB7HQ==',key_name='tempest-keypair-680494624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f6a908740a4a628e63485b71dc0e50',ramdisk_id='',reservation_id='r-r8plopn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2121002479',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2121002479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76623c68b4234fc3b4b1d7ceedd7044c',uuid=8e2966a4-412c-4a3c-befd-31cfa17a77d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converting VIF {"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG os_vif [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28064641-7b07-5b8d-ae11-2b9e851f838a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67c860c4-a2, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67c860c4-a2, col_values=(('qos', UUID('61e4e1a3-0ea2-464c-a4ff-0c200e6698e2')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67c860c4-a2, col_values=(('external_ids', {'iface-id': '67c860c4-a227-4aea-9577-af4e7d509c90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:26:d6', 'vm-uuid': '8e2966a4-412c-4a3c-befd-31cfa17a77d7'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:02 user nova-compute[75073]: INFO os_vif [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2')
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No VIF found with MAC fa:16:3e:5f:26:d6, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:31:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updated VIF entry in instance network info cache for port 67c860c4-a227-4aea-9577-af4e7d509c90. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:31:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating instance_info_cache with network_info: [{"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1643b1c2-e4ef-4cd7-91f6-52cc837e1320 req-551bce1f-0c7a-40f7-a020-de7e1b0ea6c3 service nova] Releasing lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] No waiting events found dispatching network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:04 user nova-compute[75073]: WARNING nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received unexpected event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 for instance with vm_state building and task_state spawning.
Nov 24 10:31:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] No waiting events found dispatching network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:04 user nova-compute[75073]: WARNING nova.compute.manager [req-d46184c6-ce75-496d-8c0e-44c5697be358 req-0a3280c0-8f15-4ebe-b67c-3180d4b30430 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received unexpected event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 for instance with vm_state building and task_state spawning.
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:31:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Instance spawned successfully.
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:31:06 user nova-compute[75073]: INFO nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 24 10:31:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:31:06 user nova-compute[75073]: INFO nova.compute.manager [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Took 6.05 seconds to build instance.
Nov 24 10:31:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-00c58834-0ffd-47c9-a2c3-a95f260d9ee7 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.170s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:07 user nova-compute[75073]: INFO nova.compute.manager [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Unshelving
Nov 24 10:31:07 user nova-compute[75073]: INFO nova.virt.block_device [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Booting with volume c717a11b-b615-450d-8c37-dd726611db11 at /dev/vda
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c242f2d-28ea-46ee-9e81-120d39e7c1ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254ee88-d152-443b-a2e0-d5f69e3490f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d69efd-4b31-44f5-ba2c-821f4b3068a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff158b9-7377-4f24-887e-9af7905f97e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:07 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:31:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[282fd9e6-0d9b-4457-aace-c32b298c6bac]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating existing volume attachment record: 0f259fd5-bed5-47be-850b-5b4ea4261836 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:31:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing instance network info cache due to event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:31:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG nova.objects.instance [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'flavor' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updated VIF entry in instance network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6ce3b21e-7792-428d-adc0-8a455e7dfd3b req-a6577fbe-8ae8-4ad3-9a51-38a004a39ce4 service nova] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:09 user nova-compute[75073]: INFO nova.compute.manager [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Attaching volume 6f0b98b9-df3c-43e6-a5aa-e1839e900da3 to /dev/vdb
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.utils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb67dc3-031d-49f2-8b7c-46a5b0481bab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[32744e20-6e2e-423c-867b-e655431ee56b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97f863-196e-4ec9-a1fb-9cb450f86ace]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b3cde-faf3-4804-b0e4-4fd2b101aa25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:09 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:31:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8cc0ca-0d5e-4058-9f18-f10e5358ab6d]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG os_brick.utils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:09 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating existing volume attachment record: ef83ed6e-d1f5-4b01-8c33-40bbc2ab3ad8 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:31:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'pci_requests' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'numa_topology' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:31:14 user nova-compute[75073]: INFO nova.compute.claims [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Claim successful on node user
Nov 24 10:31:14 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:31:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:14 user nova-compute[75073]: INFO nova.network.neutron [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating port b31cc3bf-c039-4bb6-88e0-7669633eddad with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuhJzyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:15 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:15 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:15 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[72520355-85a0-4068-8054-0746c58ac0be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:31:15 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a54a7b-1627-48e7-95b7-a5eac27d811b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3] added
Nov 24 10:31:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing instance network info cache due to event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55355e4-d68a-46e8-aa01-f3ca0540499c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a68ba6c-6db0-4bd5-8b9b-b341f1fe14ba]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWuhJzyM {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWuhJzyM" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac280de1-edf7-48b1-8693-3985e93d0a26]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWuhJzyM'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e911dd6-4764-45c9-bc42-99986c06c4a2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd126138-f359-4922-9968-a3102935d7b9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:15 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:15 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:15 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:15 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbc015-b583-42d3-8fd1-756c3ba52a2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260]
Nov 24 10:31:15 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260] successful.
Nov 24 10:31:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9483fa-8ea5-4f63-9c23-825217f8f371]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c47001-4e65-44aa-a095-4401985bd570]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:16 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:16 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:16 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4740efe8-2bf1-45b4-93a5-93140072d9b1]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuhJzyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:31:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Creating image(s)
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Ensure instance console log exists: /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start _get_guest_xml network_info=[{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0f259fd5-bed5-47be-850b-5b4ea4261836', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bb2d27-81da-4ef6-a631-39ee7edd35c3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c717a11b-b615-450d-8c37-dd726611db11', 'serial': 'c717a11b-b615-450d-8c37-dd726611db11'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:31:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.objects.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Object Instance<26bb2d27-81da-4ef6-a631-39ee7edd35c3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:16 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updated VIF entry in instance network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b2418ab2-178e-4658-bdb4-0e38bbc1e3b7 req-f8d5e070-6ff5-4583-b896-e91d135d72e6 service nova] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26133353861343161', 'path': '/dev/sde'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133353861343161', 'path': '/dev/sde'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.824s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:17 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.objects.instance [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'flavor' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3954ec2-cd47-4b12-875d-956bd05b9dc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:31:17 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:31:17 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:31:17 user nova-compute[75073]:   <source dev="/dev/sde"/>
Nov 24 10:31:17 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:31:17 user nova-compute[75073]:   <serial>6f0b98b9-df3c-43e6-a5aa-e1839e900da3</serial>
Nov 24 10:31:17 user nova-compute[75073]: </disk>
Nov 24 10:31:17 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ba5ae-5ea5-44d1-a4d1-a46eba2eec73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11] added
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8838fd-1306-4153-9eaf-e6f3f6db5e58]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[550aec96-bdc5-4dde-9760-2d8b52b63880]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTMFYqEV {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTMFYqEV" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[43801846-fbef-4745-8887-085f6b303d89]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTMFYqEV'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc27001-35dc-4609-b9df-d68ff5471c3f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92078bd4-b544-4059-879a-42eb434cd920]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f6bfc-ea0c-4342-9422-f43c5654f0ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]
Nov 24 10:31:17 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc6637-98f6-4ab0-afcf-e6307d9e2088]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80b2c2-9589-4652-8050-53552f321c42]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6518b500-97d4-48fd-bcc6-708957f5d8fa]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:24:44:b9, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5a6778a5-7476-4fe2-9418-d900d3e1a207 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.366s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: INFO nova.compute.manager [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Rescuing
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== connect_volume: return (2149ms) {'type': 'block', 'scsi_wwn': '23730386262343833', 'path': '/dev/sdf'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730386262343833', 'path': '/dev/sdf'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2012259995',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:07Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'pci_devices' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.objects.base [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Object Instance<26bb2d27-81da-4ef6-a631-39ee7edd35c3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:31:18 user nova-compute[75073]:   <uuid>26bb2d27-81da-4ef6-a631-39ee7edd35c3</uuid>
Nov 24 10:31:18 user nova-compute[75073]:   <name>instance-00000011</name>
Nov 24 10:31:18 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:31:18 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:31:18 user nova-compute[75073]:   <metadata>
Nov 24 10:31:18 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:31:18 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:31:18 user nova-compute[75073]:       <nova:name>tempest-TestShelveInstance-server-1516165204</nova:name>
Nov 24 10:31:18 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:31:16</nova:creationTime>
Nov 24 10:31:18 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:31:18 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:31:18 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:31:18 user nova-compute[75073]:       <nova:owner>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:user uuid="e0ba89c696b646568b211c45f22a7280">tempest-TestShelveInstance-1895340078-project-member</nova:user>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:project uuid="335f96b94b81421e97b8fab10358d712">tempest-TestShelveInstance-1895340078</nova:project>
Nov 24 10:31:18 user nova-compute[75073]:       </nova:owner>
Nov 24 10:31:18 user nova-compute[75073]:       <nova:ports>
Nov 24 10:31:18 user nova-compute[75073]:         <nova:port uuid="b31cc3bf-c039-4bb6-88e0-7669633eddad">
Nov 24 10:31:18 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 10:31:18 user nova-compute[75073]:         </nova:port>
Nov 24 10:31:18 user nova-compute[75073]:       </nova:ports>
Nov 24 10:31:18 user nova-compute[75073]:     </nova:instance>
Nov 24 10:31:18 user nova-compute[75073]:   </metadata>
Nov 24 10:31:18 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:31:18 user nova-compute[75073]:     <system>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="serial">26bb2d27-81da-4ef6-a631-39ee7edd35c3</entry>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="uuid">26bb2d27-81da-4ef6-a631-39ee7edd35c3</entry>
Nov 24 10:31:18 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:31:18 user nova-compute[75073]:     </system>
Nov 24 10:31:18 user nova-compute[75073]:   </sysinfo>
Nov 24 10:31:18 user nova-compute[75073]:   <os>
Nov 24 10:31:18 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:31:18 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:31:18 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:31:18 user nova-compute[75073]:   </os>
Nov 24 10:31:18 user nova-compute[75073]:   <features>
Nov 24 10:31:18 user nova-compute[75073]:     <acpi/>
Nov 24 10:31:18 user nova-compute[75073]:     <apic/>
Nov 24 10:31:18 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:31:18 user nova-compute[75073]:   </features>
Nov 24 10:31:18 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:31:18 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:31:18 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:31:18 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:31:18 user nova-compute[75073]:   </clock>
Nov 24 10:31:18 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:31:18 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:31:18 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:31:18 user nova-compute[75073]:   </cpu>
Nov 24 10:31:18 user nova-compute[75073]:   <devices>
Nov 24 10:31:18 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:31:18 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:31:18 user nova-compute[75073]:       <source dev="/dev/sdf"/>
Nov 24 10:31:18 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:31:18 user nova-compute[75073]:       <serial>c717a11b-b615-450d-8c37-dd726611db11</serial>
Nov 24 10:31:18 user nova-compute[75073]:     </disk>
Nov 24 10:31:18 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:31:18 user nova-compute[75073]:       <mac address="fa:16:3e:ff:d2:86"/>
Nov 24 10:31:18 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:18 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:31:18 user nova-compute[75073]:       <target dev="tapb31cc3bf-c0"/>
Nov 24 10:31:18 user nova-compute[75073]:     </interface>
Nov 24 10:31:18 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:31:18 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3/console.log" append="off"/>
Nov 24 10:31:18 user nova-compute[75073]:     </serial>
Nov 24 10:31:18 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:31:18 user nova-compute[75073]:     <video>
Nov 24 10:31:18 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:18 user nova-compute[75073]:     </video>
Nov 24 10:31:18 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:31:18 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:31:18 user nova-compute[75073]:     </rng>
Nov 24 10:31:18 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:31:18 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:31:18 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:31:18 user nova-compute[75073]:     </memballoon>
Nov 24 10:31:18 user nova-compute[75073]:   </devices>
Nov 24 10:31:18 user nova-compute[75073]: </domain>
Nov 24 10:31:18 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2012259995',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:07Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG os_vif [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627a5c18-959e-57fe-80f8-c70365a5bfcd', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb31cc3bf-c0, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb31cc3bf-c0, col_values=(('qos', UUID('2c89f612-e2d8-4a9a-bf06-d266c0af10af')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb31cc3bf-c0, col_values=(('external_ids', {'iface-id': 'b31cc3bf-c039-4bb6-88e0-7669633eddad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:d2:86', 'vm-uuid': '26bb2d27-81da-4ef6-a631-39ee7edd35c3'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: INFO os_vif [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0')
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] No VIF found with MAC fa:16:3e:ff:d2:86, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:18 user nova-compute[75073]: WARNING nova.compute.manager [req-c7462efe-88ce-4ff0-a720-7d071c117b9b req-220099f9-381f-4d70-a713-afba429aad95 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance destroyed successfully.
Nov 24 10:31:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Attempting rescue
Nov 24 10:31:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:31:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Creating image(s)
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue" returned: 0 in 0.050s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'migration_context' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.base [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<c5d379dd-cc6c-41f0-b5e7-bc576129943a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start _get_guest_xml network_info=[{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:24:44:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.base [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<c5d379dd-cc6c-41f0-b5e7-bc576129943a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'numa_topology' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.base [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<c5d379dd-cc6c-41f0-b5e7-bc576129943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:20 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:20 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.base [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<c5d379dd-cc6c-41f0-b5e7-bc576129943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-914988472',display_name='tempest-ServerRescueNegativeTestJSON-server-914988472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-914988472',id=21,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU72AqiwNWowUgJcgIp0J+/V8VwS3rD/PPSivhlQ6EukvovdepRuIFcaTtCMaL6JZxZlfdD8/RELh7/+lx8qCKeVcqU1xsuRD5EskX2ALCNxc4A/AnVqmyenHV/HZ3HXw==',key_name='tempest-keypair-1322066976',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-7ck7xo3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:29:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b4e168f7a8473d8664e9225c867318',uuid=c5d379dd-cc6c-41f0-b5e7-bc576129943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:24:44:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "vif_mac": "fa:16:3e:24:44:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.objects.base [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Object Instance<c5d379dd-cc6c-41f0-b5e7-bc576129943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:31:20 user nova-compute[75073]:   <uuid>c5d379dd-cc6c-41f0-b5e7-bc576129943a</uuid>
Nov 24 10:31:20 user nova-compute[75073]:   <name>instance-00000015</name>
Nov 24 10:31:20 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:31:20 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:31:20 user nova-compute[75073]:   <metadata>
Nov 24 10:31:20 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:31:20 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-914988472</nova:name>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:31:20</nova:creationTime>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:31:20 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:31:20 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:owner>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:user uuid="22b4e168f7a8473d8664e9225c867318">tempest-ServerRescueNegativeTestJSON-443087693-project-member</nova:user>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:project uuid="b7d3f3f3d5494608acae0f64a9bf8e9a">tempest-ServerRescueNegativeTestJSON-443087693</nova:project>
Nov 24 10:31:20 user nova-compute[75073]:       </nova:owner>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:31:20 user nova-compute[75073]:       <nova:ports>
Nov 24 10:31:20 user nova-compute[75073]:         <nova:port uuid="788218bb-1988-4aed-95a1-b144fa414dc0">
Nov 24 10:31:20 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:31:20 user nova-compute[75073]:         </nova:port>
Nov 24 10:31:20 user nova-compute[75073]:       </nova:ports>
Nov 24 10:31:20 user nova-compute[75073]:     </nova:instance>
Nov 24 10:31:20 user nova-compute[75073]:   </metadata>
Nov 24 10:31:20 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:31:20 user nova-compute[75073]:     <system>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="serial">c5d379dd-cc6c-41f0-b5e7-bc576129943a</entry>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="uuid">c5d379dd-cc6c-41f0-b5e7-bc576129943a</entry>
Nov 24 10:31:20 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:31:20 user nova-compute[75073]:     </system>
Nov 24 10:31:20 user nova-compute[75073]:   </sysinfo>
Nov 24 10:31:20 user nova-compute[75073]:   <os>
Nov 24 10:31:20 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:31:20 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:31:20 user nova-compute[75073]:   </os>
Nov 24 10:31:20 user nova-compute[75073]:   <features>
Nov 24 10:31:20 user nova-compute[75073]:     <acpi/>
Nov 24 10:31:20 user nova-compute[75073]:     <apic/>
Nov 24 10:31:20 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:31:20 user nova-compute[75073]:   </features>
Nov 24 10:31:20 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:31:20 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:31:20 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:31:20 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:31:20 user nova-compute[75073]:   </clock>
Nov 24 10:31:20 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:31:20 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:31:20 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:31:20 user nova-compute[75073]:   </cpu>
Nov 24 10:31:20 user nova-compute[75073]:   <devices>
Nov 24 10:31:20 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:31:20 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:31:20 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue"/>
Nov 24 10:31:20 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:31:20 user nova-compute[75073]:     </disk>
Nov 24 10:31:20 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:31:20 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:31:20 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk"/>
Nov 24 10:31:20 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:31:20 user nova-compute[75073]:     </disk>
Nov 24 10:31:20 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:31:20 user nova-compute[75073]:       <mac address="fa:16:3e:24:44:b9"/>
Nov 24 10:31:20 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:20 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:31:20 user nova-compute[75073]:       <target dev="tap788218bb-19"/>
Nov 24 10:31:20 user nova-compute[75073]:     </interface>
Nov 24 10:31:20 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:31:20 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/console.log" append="off"/>
Nov 24 10:31:20 user nova-compute[75073]:     </serial>
Nov 24 10:31:20 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:31:20 user nova-compute[75073]:     <video>
Nov 24 10:31:20 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:20 user nova-compute[75073]:     </video>
Nov 24 10:31:20 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:31:20 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:31:20 user nova-compute[75073]:     </rng>
Nov 24 10:31:20 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:31:20 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:31:20 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:31:20 user nova-compute[75073]:     </memballoon>
Nov 24 10:31:20 user nova-compute[75073]:   </devices>
Nov 24 10:31:20 user nova-compute[75073]: </domain>
Nov 24 10:31:20 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:31:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance destroyed successfully.
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] No VIF found with MAC fa:16:3e:24:44:b9, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:21 user nova-compute[75073]: WARNING nova.compute.manager [req-fee19258-ae1d-4552-a6b9-70ae5d923774 req-d5ee02d7-99da-41d5-9e16-7c7f97d9108f service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:23 user nova-compute[75073]: WARNING nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:23 user nova-compute[75073]: WARNING nova.compute.manager [req-3f6ecf6f-6a5e-47a1-b274-e23b5fd9f374 req-7efd9ce3-8bba-41b1-8d10-8656dc1081bb service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state active and task_state rescuing.
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:31:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance spawned successfully.
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ab6ea3b2-8332-4faf-b430-fd01319b521b tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.166s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-14dff03b-852c-4caa-9bd3-66537dc68f1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:31:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Port 2345385d-d91c-4da6-b345-9216c98a05c2 binding to destination host user is already ACTIVE {{(pid=75073) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 10:31:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Creating tmpfile /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/tmp0ww4m38z to verify with other compute node that the instance is on the same shared storage. {{(pid=75073) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:35 user nova-compute[75073]: WARNING nova.compute.manager [req-6fa4be05-49d2-404f-8778-5e13a3c9af1a req-ff239f35-0ab2-479c-a29e-d8778a0ee69d service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state resized and task_state resize_reverting.
Nov 24 10:31:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance destroyed successfully.
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'resources' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG os_vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2345385d-d9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=921b7619-dff1-4f92-8a32-e596674cb708) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:36 user nova-compute[75073]: INFO os_vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:31:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:36 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b06baf-7bed-495b-9e64-0313ed5b813f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:31:36 user nova-compute[75073]: No targets found.
Nov 24 10:31:36 user nova-compute[75073]: iSNS:
Nov 24 10:31:36 user nova-compute[75073]: No targets found.
Nov 24 10:31:36 user nova-compute[75073]: STATIC:
Nov 24 10:31:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:31:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:31:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:31:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11
Nov 24 10:31:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:31:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:31:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:31:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:31:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:31:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:31:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:31:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:31:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:31:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:31:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:31:36 user nova-compute[75073]: FIRMWARE:
Nov 24 10:31:36 user nova-compute[75073]: No targets found.
Nov 24 10:31:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:31:36 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:31:36 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[17973751-1c1a-42df-9dbb-64c6693c25f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b057b-154b-4037-be6a-64772e23f8a1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23872f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945330d-d77a-4888-9e7b-d3088f61f368]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f02162-4eb4-4b1b-b80e-8f7bc5141cb8]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f082d47e-07fc-418a-9611-2d53df997440]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de62357d-757d-4084-850c-44bedb0603b6]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7430d03-c108-402b-970f-5186eb99eb3e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed9dc0c-a54f-4d04-9518-0556f68a1c42]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:31:36 user nova-compute[75073]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:31:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcf3eb5-caac-4abc-9e7f-10213f9a774e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== disconnect_volume: return (336ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:31:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'migration_context' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.objects.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Object Instance<6352329f-a8ce-4008-b736-737934dd1b52> lazy-loaded attributes: resources,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:37 user nova-compute[75073]: WARNING nova.compute.manager [req-36da2cf3-5549-4557-bea2-7e9f0a699156 req-6cf8fdb7-3812-4ee6-84a5-ba9497dbebb9 service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state resized and task_state resize_reverting.
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.424s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:31:37 user nova-compute[75073]: INFO nova.compute.manager [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Swapping old allocation on dict_keys(['b8421a5b-83de-4630-bf28-983e95daab87']) held by migration a92edc21-64f9-42f8-b9e7-c7ad22178c6b for instance
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Overwriting current allocation {'allocations': {'b8421a5b-83de-4630-bf28-983e95daab87': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': '496d4b08c8784b6b8afeb105d7fef10f', 'user_id': '42d05b01c17a48aa93bcd7a4078332d7', 'consumer_generation': 1} on consumer 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquired lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Releasing lock "refresh_cache-6352329f-a8ce-4008-b736-737934dd1b52" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.utils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce13caa9-3f52-4ccf-add2-91ae096928e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be659aa0-52ed-4ec7-8672-c42cc9aa2c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd433a1-734a-484a-9a08-8a3ab7eac6e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9ad90-b135-4274-8e65-a87143d19825]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:31:38 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:31:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb98c661-de86-40f5-961f-3ea676d2f8b7]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:31:38 user nova-compute[75073]: DEBUG os_brick.utils [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Starting finish_revert_migration {{(pid=75073) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start _get_guest_xml network_info=[{"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c43f54e4-5c74-4b2e-9b21-73adc08098d6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6352329f-a8ce-4008-b736-737934dd1b52', 'attached_at': '2023-11-24T10:31:44.000000', 'detached_at': '', 'volume_id': '37ce071a-87ca-4e08-aade-46e7e26fd53a', 'serial': '37ce071a-87ca-4e08-aade-46e7e26fd53a'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:44 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:31:44 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:44 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:31:44 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4740d9d-9d82-4606-819f-cabbc0e1fc74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:31:44 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdbe98-08d8-405f-9363-f189867eb6e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a] added
Nov 24 10:31:44 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1df817-8773-4bee-bf38-32cf081c7d7c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b53cc2-af88-457a-a2c6-4617d4a2e41d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnKwdRpj" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150e091-e912-441f-a458-5a5fc7b14937]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnKwdRpj'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec613212-e272-4bac-83bd-11f677a6fc1e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c20462-9956-4eaf-a8a0-3abed3a364f9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:44 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a716cd-0719-4af0-a09e-c485d42d208b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:31:44 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:31:44 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca29c2c-46b0-4c87-9a94-b036c3710b61]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:31:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce2d547-090c-4b1c-adcc-0d3105fa2b10]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:31:45 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:31:45 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec4332-322a-4f8e-b9a4-b59abf04dfc3]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:31:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032663031636561', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:31:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.244056701660156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:31:46 user nova-compute[75073]:   <uuid>6352329f-a8ce-4008-b736-737934dd1b52</uuid>
Nov 24 10:31:46 user nova-compute[75073]:   <name>instance-0000000f</name>
Nov 24 10:31:46 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:31:46 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:31:46 user nova-compute[75073]:   <metadata>
Nov 24 10:31:46 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:31:46 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherB-server-1321166727</nova:name>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:31:44</nova:creationTime>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:31:46 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:31:46 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:owner>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:user uuid="42d05b01c17a48aa93bcd7a4078332d7">tempest-ServerActionsTestOtherB-1373511819-project-member</nova:user>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:project uuid="496d4b08c8784b6b8afeb105d7fef10f">tempest-ServerActionsTestOtherB-1373511819</nova:project>
Nov 24 10:31:46 user nova-compute[75073]:       </nova:owner>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:31:46 user nova-compute[75073]:       <nova:ports>
Nov 24 10:31:46 user nova-compute[75073]:         <nova:port uuid="2345385d-d91c-4da6-b345-9216c98a05c2">
Nov 24 10:31:46 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 10:31:46 user nova-compute[75073]:         </nova:port>
Nov 24 10:31:46 user nova-compute[75073]:       </nova:ports>
Nov 24 10:31:46 user nova-compute[75073]:     </nova:instance>
Nov 24 10:31:46 user nova-compute[75073]:   </metadata>
Nov 24 10:31:46 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:31:46 user nova-compute[75073]:     <system>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="serial">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="uuid">6352329f-a8ce-4008-b736-737934dd1b52</entry>
Nov 24 10:31:46 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:31:46 user nova-compute[75073]:     </system>
Nov 24 10:31:46 user nova-compute[75073]:   </sysinfo>
Nov 24 10:31:46 user nova-compute[75073]:   <os>
Nov 24 10:31:46 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:31:46 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:31:46 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:31:46 user nova-compute[75073]:   </os>
Nov 24 10:31:46 user nova-compute[75073]:   <features>
Nov 24 10:31:46 user nova-compute[75073]:     <acpi/>
Nov 24 10:31:46 user nova-compute[75073]:     <apic/>
Nov 24 10:31:46 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:31:46 user nova-compute[75073]:   </features>
Nov 24 10:31:46 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:31:46 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:31:46 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:31:46 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:31:46 user nova-compute[75073]:   </clock>
Nov 24 10:31:46 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:31:46 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:31:46 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:31:46 user nova-compute[75073]:   </cpu>
Nov 24 10:31:46 user nova-compute[75073]:   <devices>
Nov 24 10:31:46 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:31:46 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:31:46 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk"/>
Nov 24 10:31:46 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:31:46 user nova-compute[75073]:     </disk>
Nov 24 10:31:46 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:31:46 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:31:46 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:31:46 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:31:46 user nova-compute[75073]:       <serial>37ce071a-87ca-4e08-aade-46e7e26fd53a</serial>
Nov 24 10:31:46 user nova-compute[75073]:     </disk>
Nov 24 10:31:46 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:31:46 user nova-compute[75073]:       <mac address="fa:16:3e:74:2d:dc"/>
Nov 24 10:31:46 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:46 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:31:46 user nova-compute[75073]:       <target dev="tap2345385d-d9"/>
Nov 24 10:31:46 user nova-compute[75073]:     </interface>
Nov 24 10:31:46 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:31:46 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/console.log" append="off"/>
Nov 24 10:31:46 user nova-compute[75073]:     </serial>
Nov 24 10:31:46 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:31:46 user nova-compute[75073]:     <video>
Nov 24 10:31:46 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:31:46 user nova-compute[75073]:     </video>
Nov 24 10:31:46 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:31:46 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:31:46 user nova-compute[75073]:     </rng>
Nov 24 10:31:46 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:31:46 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:31:46 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:31:46 user nova-compute[75073]:     </memballoon>
Nov 24 10:31:46 user nova-compute[75073]:   </devices>
Nov 24 10:31:46 user nova-compute[75073]: </domain>
Nov 24 10:31:46 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG os_vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edbb0dc6-8255-571b-9ae8-a415c2788676', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2345385d-d9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2345385d-d9, col_values=(('qos', UUID('c6df2fed-62d6-4908-a3c6-41093a782856')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2345385d-d9, col_values=(('external_ids', {'iface-id': '2345385d-d91c-4da6-b345-9216c98a05c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:2d:dc', 'vm-uuid': '6352329f-a8ce-4008-b736-737934dd1b52'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: INFO os_vif [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 52a44464-e0d3-4620-9d54-37fd4d82d32c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:31:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:47 user nova-compute[75073]: WARNING nova.compute.manager [req-3ad11e90-da53-4100-a6a6-a70bfe8c34b7 req-1ecfb70b-8112-4b73-9b24-585d61985abf service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state resized and task_state resize_reverting.
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:31:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [{"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-368baad5-b756-4ae5-aa18-9d148632523d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:31:49 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance running successfully.
Nov 24 10:31:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] finish_revert_migration finished successfully. {{(pid=75073) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:31:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:31:49 user nova-compute[75073]: WARNING nova.compute.manager [req-9cbe9531-9c00-4c90-be8d-dd6ccb897cd4 req-542cceca-b711-4d5e-a5a2-6c440a502eff service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state resized and task_state resize_reverting.
Nov 24 10:31:49 user nova-compute[75073]: INFO nova.compute.manager [None req-ff2352d5-dac0-4df9-b4e3-9c4cfd24874b tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance to original state: 'active'
Nov 24 10:31:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:31:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:31:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:31:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'flavor' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:00 user nova-compute[75073]: INFO nova.compute.manager [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attaching volume e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 to /dev/vdb
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.utils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228bc52-1725-466f-9a80-a5d3a4a78d30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0255a3-9cc8-41ec-bef7-c35fdc50a2f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[269b9835-38b0-4aec-a7f0-1fd51ee07e06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[10683b79-b8a0-448b-ae4e-903a2e8db206]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:32:00 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:32:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c375c-e6a9-4e00-9fb5-9146fa698a47]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG os_brick.utils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:32:00 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating existing volume attachment record: f0908f34-671a-4ada-b390-37689beec317 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:32:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:07 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:07 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:07 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3416cc-ccea-4d9d-bfba-1d81a2a1ffa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:32:07 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e1b29-3cd4-4118-bebd-fe63e5fb34ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196] added
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f203235-9f0a-4559-abd1-5d0b0547a10c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0584ec9f-a853-4436-8e4d-4ee30a537e0d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONbuxKsd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONbuxKsd" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[365fd561-7c5c-458d-b8ba-6fa09b599f3a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONbuxKsd'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff0741-d5c8-4889-aa78-8cd0549e0ff1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd9ba1-2ee7-4929-a2bc-d33c0b8b1751]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[850dc1f1-4d48-4e76-bfec-660cf1841e7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260]
Nov 24 10:32:07 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260] successful.
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52911b9-3252-45fb-8c1f-a0c7ed730f3b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63914e4-52e8-4803-9be5-9f931b29a1af]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:07 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd78b9fd-3640-45ce-96ad-1fc6385462ed]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:32:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:32:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23664373339393736', 'path': '/dev/sdg'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:32:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373339393736', 'path': '/dev/sdg'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:32:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'flavor' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:32:08 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:32:08 user nova-compute[75073]:   <source dev="/dev/sdg"/>
Nov 24 10:32:08 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:32:08 user nova-compute[75073]:   <serial>e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196</serial>
Nov 24 10:32:08 user nova-compute[75073]: </disk>
Nov 24 10:32:08 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:32:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:32:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:32:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No VIF found with MAC fa:16:3e:a0:c7:70, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:32:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ff12eca3-3d13-4e2f-a79f-462c4dbd20f0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.594s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:10 user nova-compute[75073]: INFO nova.compute.manager [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Rescuing
Nov 24 10:32:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:32:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:32:10 user nova-compute[75073]: DEBUG nova.network.neutron [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG nova.network.neutron [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:11 user nova-compute[75073]: WARNING nova.compute.manager [req-060eb70b-28d1-47c9-a5ad-49100ab5d808 req-af06867c-3302-4cdb-b251-dcb14f4f87b3 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state active and task_state rescuing.
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance destroyed successfully.
Nov 24 10:32:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attempting a stable device rescue
Nov 24 10:32:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:32:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Creating image(s)
Nov 24 10:32:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'trusted_certs' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:13 user nova-compute[75073]: WARNING nova.compute.manager [req-b164eb22-30f2-49d4-9dcd-649e9d6b4df0 req-945099df-13c4-46fe-9376-11f521dfcec6 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state active and task_state rescuing.
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG nova.virt.images [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] e711da44-613b-4a91-9733-96fb7bb67712 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:32:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.part /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.part /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.converted" returned: 0 in 0.408s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.017s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01 --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01,backing_fmt=raw /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01,backing_fmt=raw /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue" returned: 0 in 0.051s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "6ae3aad17a6b56f242b579cc7ea05c0904522e01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'migration_context' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Object Instance<22994ffd-5bf9-460c-a04a-2b206c7fd02f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start _get_guest_xml network_info=[{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "vif_mac": "fa:16:3e:a0:c7:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e711da44-613b-4a91-9733-96fb7bb67712', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'f0908f34-671a-4ada-b390-37689beec317', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '22994ffd-5bf9-460c-a04a-2b206c7fd02f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'serial': 'e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'resources' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Object Instance<22994ffd-5bf9-460c-a04a-2b206c7fd02f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'numa_topology' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Object Instance<22994ffd-5bf9-460c-a04a-2b206c7fd02f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:32:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:32:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Object Instance<22994ffd-5bf9-460c-a04a-2b206c7fd02f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:14 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:14 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:14 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a605b93-5a1a-47b2-a0b8-97094040bd45]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ONbuxKsd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 10:32:14 user nova-compute[75073]: node.name = iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:32:14 user nova-compute[75073]: node.tpgt = -1
Nov 24 10:32:14 user nova-compute[75073]: node.startup = automatic
Nov 24 10:32:14 user nova-compute[75073]: node.leading_login = No
Nov 24 10:32:14 user nova-compute[75073]: iface.iscsi_ifacename = default
Nov 24 10:32:14 user nova-compute[75073]: iface.net_ifacename = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.ipaddress = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.prefix_len = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.hwaddress = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.transport_name = tcp
Nov 24 10:32:14 user nova-compute[75073]: iface.initiatorname = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.vlan_id = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.vlan_priority = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.vlan_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.iface_num = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.mtu = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.port = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.bootproto = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.subnet_mask = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.gateway = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_alt_client_id = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_dns = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_learn_iqn = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_vendor_id_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_vendor_id = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.dhcp_slp_da = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.fragmentation = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.gratuitous_arp = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.incoming_forwarding = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.tos_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.tos = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.ttl = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.delayed_ack = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.tcp_nagle = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.tcp_wsf_state = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.tcp_wsf = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.tcp_timer_scale = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.tcp_timestamp = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.redirect = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.def_task_mgmt_timeout = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.header_digest = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.data_digest = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.immediate_data = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.initial_r2t = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.data_seq_inorder = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.data_pdu_inorder = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.erl = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.max_receive_data_len = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.first_burst_len = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.max_outstanding_r2t = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.max_burst_len = 0
Nov 24 10:32:14 user nova-compute[75073]: iface.chap_auth = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.bidi_chap = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.strict_login_compliance = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.discovery_auth = <empty>
Nov 24 10:32:14 user nova-compute[75073]: iface.discovery_logout = <empty>
Nov 24 10:32:14 user nova-compute[75073]: node.discovery_address = <empty>
Nov 24 10:32:14 user nova-compute[75073]: node.discovery_port = 0
Nov 24 10:32:14 user nova-compute[75073]: node.discovery_type = static
Nov 24 10:32:14 user nova-compute[75073]: node.session.initial_cmdsn = 0
Nov 24 10:32:14 user nova-compute[75073]: node.session.initial_login_retry_max = 8
Nov 24 10:32:14 user nova-compute[75073]: node.session.xmit_thread_priority = -20
Nov 24 10:32:14 user nova-compute[75073]: node.session.cmds_max = 128
Nov 24 10:32:14 user nova-compute[75073]: node.session.queue_depth = 32
Nov 24 10:32:14 user nova-compute[75073]: node.session.nr_sessions = 1
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.authmethod = CHAP
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.username = ONbuxKsd
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.password = ***
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.username_in = <empty>
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.password_in = <empty>
Nov 24 10:32:14 user nova-compute[75073]: node.session.auth.chap_algs = MD5
Nov 24 10:32:14 user nova-compute[75073]: node.session.timeo.replacement_timeout = 120
Nov 24 10:32:14 user nova-compute[75073]: node.session.err_timeo.abort_timeout = 15
Nov 24 10:32:14 user nova-compute[75073]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 10:32:14 user nova-compute[75073]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 10:32:14 user nova-compute[75073]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.FastAbort = Yes
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.InitialR2T = No
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.ImmediateData = Yes
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.MaxConnections = 1
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 10:32:14 user nova-compute[75073]: node.session.iscsi.ERL = 0
Nov 24 10:32:14 user nova-compute[75073]: node.session.scan = manual
Nov 24 10:32:14 user nova-compute[75073]: node.session.reopen_max = 0
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].address = 172.16.0.220
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].port = 3260
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].startup = manual
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].tcp.window_size = 524288
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].tcp.type_of_service = 0
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].timeo.logout_timeout = 15
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].timeo.login_timeout = 15
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].timeo.auth_timeout = 45
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.DataDigest = None
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.IFMarker = No
Nov 24 10:32:14 user nova-compute[75073]: node.conn[0].iscsi.OFMarker = No
Nov 24 10:32:14 user nova-compute[75073]: # END RECORD
Nov 24 10:32:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b1203-a306-42e1-9fa2-e3633ff56626]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaed3fc-6694-4967-a1f7-01eaee9f3572]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONbuxKsd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONbuxKsd" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90570cb-ca3b-4cea-b10f-593825324a46]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONbuxKsd'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa60db7-37d7-43d2-b18b-9578b6d96bcc]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fafc0-bb89-49b0-8fee-d5cba2d51e1e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:14 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] HCTL ('38', '0', '0', 0) found on session 32 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2ce324-f7b7-4abd-9852-5f2a78190f26]: (4, ('0 0 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Searching for a device in session 32 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23664373339393736', 'path': '/dev/sdg'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373339393736', 'path': '/dev/sdg'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-950738275',display_name='tempest-ServerStableDeviceRescueTest-server-950738275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-950738275',id=19,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdZ5PWkX8bfykVY2l8KJWvIRywALd2orQ4pyUssBpDc23j4tCwwoKXQPogM4FIiMY3nqQSfZEej4LrqxQcCWnpAHgsx6N6SG/7v4/Lax41EvxzA/qM/TFD6uwDG0mqLLw==',key_name='tempest-keypair-1817962517',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:28:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b3012c563042da9cf3f61dac69d570',ramdisk_id='',reservation_id='r-wryojn74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-987992993',owner_user_name='tempest-ServerStableDeviceRescueTest-987992993-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e945ba41be374114af0acb30cea23c96',uuid=22994ffd-5bf9-460c-a04a-2b206c7fd02f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "vif_mac": "fa:16:3e:a0:c7:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converting VIF {"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "vif_mac": "fa:16:3e:a0:c7:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'pci_devices' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.objects.base [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Object Instance<22994ffd-5bf9-460c-a04a-2b206c7fd02f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:32:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:32:14 user nova-compute[75073]:   <uuid>22994ffd-5bf9-460c-a04a-2b206c7fd02f</uuid>
Nov 24 10:32:14 user nova-compute[75073]:   <name>instance-00000013</name>
Nov 24 10:32:14 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:32:14 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:32:14 user nova-compute[75073]:   <metadata>
Nov 24 10:32:14 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:32:14 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-950738275</nova:name>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:32:14</nova:creationTime>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:32:14 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:32:14 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:owner>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:user uuid="e945ba41be374114af0acb30cea23c96">tempest-ServerStableDeviceRescueTest-987992993-project-member</nova:user>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:project uuid="b0b3012c563042da9cf3f61dac69d570">tempest-ServerStableDeviceRescueTest-987992993</nova:project>
Nov 24 10:32:14 user nova-compute[75073]:       </nova:owner>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:32:14 user nova-compute[75073]:       <nova:ports>
Nov 24 10:32:14 user nova-compute[75073]:         <nova:port uuid="dd74395e-1c17-4c29-b311-7457e29711ea">
Nov 24 10:32:14 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:32:14 user nova-compute[75073]:         </nova:port>
Nov 24 10:32:14 user nova-compute[75073]:       </nova:ports>
Nov 24 10:32:14 user nova-compute[75073]:     </nova:instance>
Nov 24 10:32:14 user nova-compute[75073]:   </metadata>
Nov 24 10:32:14 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:32:14 user nova-compute[75073]:     <system>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="serial">22994ffd-5bf9-460c-a04a-2b206c7fd02f</entry>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="uuid">22994ffd-5bf9-460c-a04a-2b206c7fd02f</entry>
Nov 24 10:32:14 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:32:14 user nova-compute[75073]:     </system>
Nov 24 10:32:14 user nova-compute[75073]:   </sysinfo>
Nov 24 10:32:14 user nova-compute[75073]:   <os>
Nov 24 10:32:14 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:32:14 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:32:14 user nova-compute[75073]:   </os>
Nov 24 10:32:14 user nova-compute[75073]:   <features>
Nov 24 10:32:14 user nova-compute[75073]:     <acpi/>
Nov 24 10:32:14 user nova-compute[75073]:     <apic/>
Nov 24 10:32:14 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:32:14 user nova-compute[75073]:   </features>
Nov 24 10:32:14 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:32:14 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:32:14 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:32:14 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:32:14 user nova-compute[75073]:   </clock>
Nov 24 10:32:14 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:32:14 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:32:14 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:32:14 user nova-compute[75073]:   </cpu>
Nov 24 10:32:14 user nova-compute[75073]:   <devices>
Nov 24 10:32:14 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:32:14 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:32:14 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk"/>
Nov 24 10:32:14 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:32:14 user nova-compute[75073]:     </disk>
Nov 24 10:32:14 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:32:14 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:32:14 user nova-compute[75073]:       <source dev="/dev/sdg"/>
Nov 24 10:32:14 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:32:14 user nova-compute[75073]:       <serial>e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196</serial>
Nov 24 10:32:14 user nova-compute[75073]:     </disk>
Nov 24 10:32:14 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:32:14 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:32:14 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue"/>
Nov 24 10:32:14 user nova-compute[75073]:       <target dev="vdc" bus="virtio"/>
Nov 24 10:32:14 user nova-compute[75073]:       <boot order="1"/>
Nov 24 10:32:14 user nova-compute[75073]:     </disk>
Nov 24 10:32:14 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:32:14 user nova-compute[75073]:       <mac address="fa:16:3e:a0:c7:70"/>
Nov 24 10:32:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:32:14 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:32:14 user nova-compute[75073]:       <target dev="tapdd74395e-1c"/>
Nov 24 10:32:14 user nova-compute[75073]:     </interface>
Nov 24 10:32:14 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:32:14 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/console.log" append="off"/>
Nov 24 10:32:14 user nova-compute[75073]:     </serial>
Nov 24 10:32:14 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:32:14 user nova-compute[75073]:     <video>
Nov 24 10:32:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:32:14 user nova-compute[75073]:     </video>
Nov 24 10:32:14 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:32:14 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:32:14 user nova-compute[75073]:     </rng>
Nov 24 10:32:14 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:32:14 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:32:14 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:32:14 user nova-compute[75073]:     </memballoon>
Nov 24 10:32:14 user nova-compute[75073]:   </devices>
Nov 24 10:32:14 user nova-compute[75073]: </domain>
Nov 24 10:32:14 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:32:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance destroyed successfully.
Nov 24 10:32:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:32:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:32:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:32:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] No VIF found with MAC fa:16:3e:a0:c7:70, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:16 user nova-compute[75073]: WARNING nova.compute.manager [req-965d9b17-7f65-46c9-9119-355b4e709855 req-42477b71-ac07-42dc-b1c0-d82c4ea165bd service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state active and task_state rescuing.
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-67562cdf-d394-4086-b6cb-0fae894326ae tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:18 user nova-compute[75073]: WARNING nova.compute.manager [req-8bef2849-c18b-4f25-a997-75920a8516cc req-abcc657c-45bc-49a6-8927-928bde2927ce service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state active and task_state rescuing.
Nov 24 10:32:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:23 user nova-compute[75073]: INFO nova.compute.manager [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Unrescuing
Nov 24 10:32:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG nova.network.neutron [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG nova.network.neutron [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG nova.objects.instance [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'flavor' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:24 user nova-compute[75073]: WARNING nova.compute.manager [req-91640695-b64b-4616-bfd5-af8e8c379394 req-4bb3424f-a5bc-43d6-8a46-c41d8565fa90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:32:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance destroyed successfully.
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:26 user nova-compute[75073]: WARNING nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:26 user nova-compute[75073]: WARNING nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:26 user nova-compute[75073]: WARNING nova.compute.manager [req-420a8228-7fb6-41fd-aebf-cf2c9b5a94df req-765a9da0-a4f8-4eb2-9654-b86adbb307c1 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:32:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-12c60c44-e54c-4d3c-8129-47727f9e4ce0 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:32:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:32:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:32:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:32:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:32:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=25.175182342529297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 52a44464-e0d3-4620-9d54-37fd4d82d32c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:32:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [{"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ccb126e6-2e9f-400e-9351-8183056a5410" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-changed-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Refreshing instance network info cache due to event network-changed-67c860c4-a227-4aea-9577-af4e7d509c90. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] Acquiring lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] Acquired lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Refreshing network info cache for port 67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updated VIF entry in instance network info cache for port 67c860c4-a227-4aea-9577-af4e7d509c90. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating instance_info_cache with network_info: [{"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eb5c9c1a-d415-480d-8d72-eab7ed5b7bd6 req-5e49ab7c-70a3-4e06-8843-2f69a6bebe50 service nova] Releasing lock "refresh_cache-8e2966a4-412c-4a3c-befd-31cfa17a77d7" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:51 user nova-compute[75073]: INFO nova.compute.manager [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attaching volume bae1ba6f-55b6-47de-bac9-e651345b3c05 to /dev/vdb
Nov 24 10:32:51 user nova-compute[75073]: DEBUG os_brick.utils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ed04c-056f-4cb7-b2fb-4fa55b7f86b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c86b802-4d0b-4a0f-b3b0-d66938657f25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b1080-126c-4164-9405-605405867374]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa911da-6d2a-44e6-872a-2e432d569518]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:32:52 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:32:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[017cba88-93ef-478d-998f-eecfc780d91e]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG os_brick.utils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:32:52 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating existing volume attachment record: d2202d57-62a8-43e8-a2a1-d51d1d706fcc {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:32:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:54 user nova-compute[75073]: INFO nova.compute.manager [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Detaching volume 171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:32:54 user nova-compute[75073]: INFO nova.virt.block_device [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Attempting to driver detach volume 171e79c4-d22d-44f7-94e3-76b8301e10d8 from mountpoint /dev/vdb
Nov 24 10:32:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Attempting to detach device vdb from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:32:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:32:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:32:54 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:32:54 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:32:54 user nova-compute[75073]:   <serial>171e79c4-d22d-44f7-94e3-76b8301e10d8</serial>
Nov 24 10:32:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:32:54 user nova-compute[75073]: </disk>
Nov 24 10:32:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:32:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully detached device vdb from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the persistent domain config.
Nov 24 10:32:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:32:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:32:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:32:54 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:32:54 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:32:54 user nova-compute[75073]:   <serial>171e79c4-d22d-44f7-94e3-76b8301e10d8</serial>
Nov 24 10:32:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:32:54 user nova-compute[75073]: </disk>
Nov 24 10:32:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:32:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:32:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing instance network info cache due to event network-changed-b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] Acquiring lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] Acquired lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Refreshing network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:58 user nova-compute[75073]: INFO nova.compute.manager [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Terminating instance
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpaEPhVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:58 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:58 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:58 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234a95f-c1c6-4173-afe0-89ee365d3a3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:32:58 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7591ae5-55c8-4287-b2cb-7bae6d2cc904]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05] added
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d9ab2e-f6d8-49ca-90d2-1294125e9bb1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[163bbf1b-83ca-4d88-85ec-bc49acb5f3c5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpaEPhVc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpaEPhVc" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a7a9b-8534-4687-941c-2664727acfa1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpaEPhVc'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e30a9-cd2e-4e55-827c-25bce9353523]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e91b54-a1ca-465b-80e4-5db066177e19]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12d996a-1a23-48d1-8bd6-5fa70c9fc4da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260]
Nov 24 10:32:58 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260] successful.
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e320b9-b346-4ae2-b63f-20e42246bf6d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d697f5d4-cd4c-4a08-a5e5-5f36d092c76b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:32:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c153a960-2772-490f-a808-cbe12d7d5174]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpaEPhVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-68862267-2821-4bf0-b1ad-c30ace95821f req-3eea3abe-30c3-4b02-b431-abe180e97389 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-unplugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updated VIF entry in instance network info cache for port b31cc3bf-c039-4bb6-88e0-7669633eddad. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:32:58 user nova-compute[75073]: DEBUG nova.network.neutron [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [{"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2befa1c5-151b-4f93-8069-a67646c657ba req-ac48278f-99c2-4d66-bf59-c86b651daafa service nova] Releasing lock "refresh_cache-26bb2d27-81da-4ef6-a631-39ee7edd35c3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Instance destroyed successfully.
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lazy-loading 'resources' on Instance uuid 26bb2d27-81da-4ef6-a631-39ee7edd35c3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516165204',display_name='tempest-TestShelveInstance-server-1516165204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516165204',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE0vzlQS+Ale4pn8cmHkdIcvb1/JfNkNZ/l7sHvPhTj+Id+QbzA44ZQgdp01+47H5RXzUGimXjG/DzdIpo0bymFfa5cc82Jty0t8iiRxUlBzyYpvKbKPmnB02mGogsj0Q==',key_name='tempest-TestShelveInstance-2012259995',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f96b94b81421e97b8fab10358d712',ramdisk_id='',reservation_id='r-avst6tbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1895340078',owner_user_name='tempest-TestShelveInstance-1895340078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:23Z,user_data=None,user_id='e0ba89c696b646568b211c45f22a7280',uuid=26bb2d27-81da-4ef6-a631-39ee7edd35c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converting VIF {"id": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "address": "fa:16:3e:ff:d2:86", "network": {"id": "ae649880-81ec-4ce3-852e-5f82dbaa14bd", "bridge": "br-int", "label": "tempest-TestShelveInstance-154177909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335f96b94b81421e97b8fab10358d712", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31cc3bf-c0", "ovs_interfaceid": "b31cc3bf-c039-4bb6-88e0-7669633eddad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_vif [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb31cc3bf-c0, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c89f612-e2d8-4a9a-bf06-d266c0af10af) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:32:59 user nova-compute[75073]: INFO os_vif [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d2:86,bridge_name='br-int',has_traffic_filtering=True,id=b31cc3bf-c039-4bb6-88e0-7669633eddad,network=Network(ae649880-81ec-4ce3-852e-5f82dbaa14bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31cc3bf-c0')
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTMFYqEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:32:59 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23334643638333430', 'path': '/dev/sdh'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334643638333430', 'path': '/dev/sdh'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.536s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a078629d-37f8-4d2c-aff5-ee97c93f5226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:32:59 user nova-compute[75073]: No targets found.
Nov 24 10:32:59 user nova-compute[75073]: iSNS:
Nov 24 10:32:59 user nova-compute[75073]: No targets found.
Nov 24 10:32:59 user nova-compute[75073]: STATIC:
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:32:59 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:32:59 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:32:59 user nova-compute[75073]: FIRMWARE:
Nov 24 10:32:59 user nova-compute[75073]: No targets found.
Nov 24 10:32:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:32:59 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:32:59 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:32:59 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:32:59 user nova-compute[75073]:   <source dev="/dev/sdh"/>
Nov 24 10:32:59 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:32:59 user nova-compute[75073]:   <serial>bae1ba6f-55b6-47de-bac9-e651345b3c05</serial>
Nov 24 10:32:59 user nova-compute[75073]: </disk>
Nov 24 10:32:59 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb805c-d046-4186-a4f6-5cab1f8b9d29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f146d-7f0c-4f30-ac62-a0c1ce3df331]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:32:59 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb241672ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11'): ({'sdf'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Removing single pathed devices sdf {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e947ea1-9275-430f-9451-5f13797e3fca]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641abdd-1b42-440e-afbb-9f0ad450c5a1]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Flushing IO for device /dev/sdf {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1e95d-8410-4c67-8765-0b86b0d12916]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b66981c-0cd7-4509-bf5a-5274b6bd6600]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:32:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be48c07c-0449-4f02-b31e-e33be2ec09e8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a44bad-3f26-4f51-a399-829082decb27]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260]
Nov 24 10:33:00 user nova-compute[75073]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11, portal: 172.16.0.220,3260] successful.
Nov 24 10:33:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c717a11b-b615-450d-8c37-dd726611db11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a91ccf7-3bab-46fb-a7ff-4c69e553e698]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] <== disconnect_volume: return (861ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:33:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deleting instance files /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3_del
Nov 24 10:33:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deletion of /opt/stack/data/nova/instances/26bb2d27-81da-4ef6-a631-39ee7edd35c3_del complete
Nov 24 10:33:00 user nova-compute[75073]: INFO nova.compute.manager [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No VIF found with MAC fa:16:3e:5f:26:d6, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ec7ac929-90b0-4443-a14b-bfea7f6aece1 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.430s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:33:00 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Took 0.39 seconds to deallocate network for instance.
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] Acquiring lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] No waiting events found dispatching network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:00 user nova-compute[75073]: WARNING nova.compute.manager [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received unexpected event network-vif-plugged-b31cc3bf-c039-4bb6-88e0-7669633eddad for instance with vm_state active and task_state deleting.
Nov 24 10:33:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-f330473d-46a6-49fe-ac48-7aa1f3fe1168 req-aa87ef74-1526-4c44-a3c6-203e8892f4c8 service nova] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Received event network-vif-deleted-b31cc3bf-c039-4bb6-88e0-7669633eddad {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:01 user nova-compute[75073]: INFO nova.compute.manager [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Took 0.75 seconds to detach 1 volumes for instance.
Nov 24 10:33:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] [instance: 26bb2d27-81da-4ef6-a631-39ee7edd35c3] Deleting volume: c717a11b-b615-450d-8c37-dd726611db11 {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:33:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:33:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:33:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:01 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Deleted allocations for instance 26bb2d27-81da-4ef6-a631-39ee7edd35c3
Nov 24 10:33:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-255526fa-e88e-473d-9398-bdef22c71f55 tempest-TestShelveInstance-1895340078 tempest-TestShelveInstance-1895340078-project-member] Lock "26bb2d27-81da-4ef6-a631-39ee7edd35c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.515s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:03 user nova-compute[75073]: INFO nova.compute.manager [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attaching volume 435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 to /dev/vdc
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.utils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d7f1f4-d25d-44f3-81db-7ce15e9520ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f21e8-fb08-4b78-a913-efffbc2ea07d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[876a041a-df19-4885-80f8-b16616119ceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3150fd-a2ba-497d-bfd0-e8661af0edea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:33:03 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:33:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201883d-e297-458e-83cf-e287a00d47d6]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG os_brick.utils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:33:03 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating existing volume attachment record: fccc756e-9f52-47a4-af55-db5b2f6ed14d {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:33:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:09 user nova-compute[75073]: INFO nova.compute.manager [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Unrescuing
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.network.neutron [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVZHAosz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:33:09 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:33:09 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:33:09 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d82be6-32fd-4345-88b5-3d16ca14714a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:33:09 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1229b7-6e04-4334-a7c3-3a4945e9a796]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44] added
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.network.neutron [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.objects.instance [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'flavor' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f539419-05a9-4d9f-8c82-a155a8b1dc49]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f69dc3c-4d02-491c-9037-cdc1e478132a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVZHAosz {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVZHAosz" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e6a5a-58d7-4030-8a27-ea837c5a4ac6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xVZHAosz'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec7d07-79d5-49cd-8d9d-52ff101e71a2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8f7f74-fa56-449b-b9f3-0b17b10f0e59]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d330282-1d8e-454b-986d-8b6692d6a86e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260]
Nov 24 10:33:09 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260] successful.
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d30eb0-6dbb-4c11-8d1f-4744657bd65a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9384535-216c-4b67-a07d-6af8c2ebc4ce]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:09 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:09 user nova-compute[75073]: WARNING nova.compute.manager [req-ad3f422d-69ae-476a-9a7e-1f387285f2e9 req-c157b11d-4372-4f27-b9e1-1324419446bf service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f410fda-8a39-4190-9694-50ca699f6197]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:33:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVZHAosz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:33:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance destroyed successfully.
Nov 24 10:33:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:33:10 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23065353061626339', 'path': '/dev/sdf'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:33:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065353061626339', 'path': '/dev/sdf'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:33:11 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:33:11 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:33:11 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:33:11 user nova-compute[75073]:   <serial>435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44</serial>
Nov 24 10:33:11 user nova-compute[75073]: </disk>
Nov 24 10:33:11 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] No VIF found with MAC fa:16:3e:5f:26:d6, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:33:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1db43e3b-49e1-438f-acb3-b6dfff0902ee tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.651s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:12 user nova-compute[75073]: WARNING nova.compute.manager [req-64c10109-0c74-4671-844f-5e056859a079 req-20eddddf-5df3-4101-a861-1bfea441b03d service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:13 user nova-compute[75073]: INFO nova.compute.manager [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Detaching volume 435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44
Nov 24 10:33:13 user nova-compute[75073]: INFO nova.virt.block_device [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attempting to driver detach volume 435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 from mountpoint /dev/vdc
Nov 24 10:33:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Attempting to detach device vdc from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:33:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:33:13 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:33:13 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:33:13 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:33:13 user nova-compute[75073]:   <serial>435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44</serial>
Nov 24 10:33:13 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:33:13 user nova-compute[75073]: </disk>
Nov 24 10:33:13 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:33:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully detached device vdc from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the persistent domain config.
Nov 24 10:33:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:33:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:33:13 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:33:13 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:33:13 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:33:13 user nova-compute[75073]:   <serial>435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44</serial>
Nov 24 10:33:13 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:33:13 user nova-compute[75073]: </disk>
Nov 24 10:33:13 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:33:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:14 user nova-compute[75073]: WARNING nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:33:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:14 user nova-compute[75073]: WARNING nova.compute.manager [req-dd5bac3b-e8df-41b1-806f-5e561c689e80 req-32a44b02-cffb-4a75-ba76-df9ec0ae8917 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:33:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-84ff69f9-6980-4a14-aae6-8b513cccd4d7 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:33:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c is timed out.
Nov 24 10:33:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully detached device vdb from instance 52a44464-e0d3-4620-9d54-37fd4d82d32c from the live domain config.
Nov 24 10:33:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmudvhKC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:33:15 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f1b4b-4dec-497a-9832-773dbdc559f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:33:15 user nova-compute[75073]: No targets found.
Nov 24 10:33:15 user nova-compute[75073]: iSNS:
Nov 24 10:33:15 user nova-compute[75073]: No targets found.
Nov 24 10:33:15 user nova-compute[75073]: STATIC:
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:33:15 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:15 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:15 user nova-compute[75073]: FIRMWARE:
Nov 24 10:33:15 user nova-compute[75073]: No targets found.
Nov 24 10:33:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:33:15 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:33:15 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca6b310-998e-4e00-8bbf-32a1225ef7d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cef394-e24d-41bc-8cf8-d7b2f6e21947]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238218b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1574b72-377c-4ea3-a8d6-b41281721d03]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b1bad-87c0-40de-8f95-83f19c391c18]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a05b6-9740-4207-ad5a-2532edc966e3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64aa4f6-8588-4f3f-adf0-09bb3b2c6456]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240d08b-efa1-4d67-ae66-df0400ae5827]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a229772-87e7-4cd9-98ec-c7318510cc04]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260]
Nov 24 10:33:15 user nova-compute[75073]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8, portal: 172.16.0.220,3260] successful.
Nov 24 10:33:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e79c4-d22d-44f7-94e3-76b8301e10d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2077ebb-70a8-4bea-a53e-8f47e8a1fd01]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== disconnect_volume: return (341ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:33:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:33:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'flavor' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e0bfecf3-01c3-4dd3-9a3a-aec12fad356c tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.874s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:33:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:33 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 is timed out.
Nov 24 10:33:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully detached device vdc from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the live domain config.
Nov 24 10:33:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVZHAosz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:33:33 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca643a0a-9f9b-4d13-9a56-eedbbf391207]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:33:33 user nova-compute[75073]: No targets found.
Nov 24 10:33:33 user nova-compute[75073]: iSNS:
Nov 24 10:33:33 user nova-compute[75073]: No targets found.
Nov 24 10:33:33 user nova-compute[75073]: STATIC:
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:33:33 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:33:33 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:33:33 user nova-compute[75073]: FIRMWARE:
Nov 24 10:33:33 user nova-compute[75073]: No targets found.
Nov 24 10:33:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:33:33 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:33:33 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70df597-4334-4b99-b945-b07746d24222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7d6e7-3581-4206-a14f-e94dc2b6c5fe]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 (non-flash)
Nov 24 10:33:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23872dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44'): ({'sdf'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Removing single pathed devices sdf {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6223a27b-736f-43ad-a325-d59600c9be21]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f7252-5d2c-4041-a4b3-44e5a6fdeb6b]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Flushing IO for device /dev/sdf {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37a4f9-585f-4bdb-92de-d4701af69924]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:33:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b6434-80fc-43f6-b5c7-3127eaa2eb7b]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb49d82-9574-4144-b1c4-cc8f2e1b5ab5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93efc3-fc06-41f7-ab94-5527be00d9eb]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260]
Nov 24 10:33:34 user nova-compute[75073]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44, portal: 172.16.0.220,3260] successful.
Nov 24 10:33:34 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435c1ca9-5ec6-45c2-ba3a-fd5b4c10bd44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5689d96-4110-4c46-bcb9-e52388487e0d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== disconnect_volume: return (349ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd96b9b-b3ec-44e7-83af-3b852df1d073 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:33:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:33:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:44 user nova-compute[75073]: INFO nova.compute.manager [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Terminating instance
Nov 24 10:33:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bfeeb96-9e2e-469e-a74c-1ce19b192f52 req-1368d229-affa-4b34-a765-c23b1d18e177 service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-unplugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Instance destroyed successfully.
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'resources' on Instance uuid 52a44464-e0d3-4620-9d54-37fd4d82d32c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968903813',display_name='tempest-ServerActionsTestOtherA-server-378441943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968903813',id=18,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPKVle8VfFhYJrk0x9AZMJgh47LrO8Qe7Qfolw6PnMQ3rGAe+GgUqRadCEfU5hb5cMQUO8LgwDnFgsUOtlM6TrgWCFI+6Jote3kXMR2nqxSw7mrUwq8fGbNqEOyMKtVxw==',key_name='tempest-keypair-1900674360',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-7vi676q2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=52a44464-e0d3-4620-9d54-37fd4d82d32c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "address": "fa:16:3e:8d:d9:5a", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3553e048-61", "ovs_interfaceid": "3553e048-612e-49d7-8cdb-6cf7a4107f5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG os_vif [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3553e048-61, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7551b9d4-d086-468e-b603-8f1fa7d27934) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:33:45 user nova-compute[75073]: INFO os_vif [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d9:5a,bridge_name='br-int',has_traffic_filtering=True,id=3553e048-612e-49d7-8cdb-6cf7a4107f5b,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3553e048-61')
Nov 24 10:33:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Deleting instance files /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c_del
Nov 24 10:33:45 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Deletion of /opt/stack/data/nova/instances/52a44464-e0d3-4620-9d54-37fd4d82d32c_del complete
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:45 user nova-compute[75073]: INFO nova.compute.manager [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:33:46 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Took 0.68 seconds to deallocate network for instance.
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:46 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Deleted allocations for instance 52a44464-e0d3-4620-9d54-37fd4d82d32c
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d98033ad-7c74-4d99-8a67-f90f995cd370 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] Acquiring lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] Lock "52a44464-e0d3-4620-9d54-37fd4d82d32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] No waiting events found dispatching network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:33:47 user nova-compute[75073]: WARNING nova.compute.manager [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received unexpected event network-vif-plugged-3553e048-612e-49d7-8cdb-6cf7a4107f5b for instance with vm_state deleted and task_state None.
Nov 24 10:33:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-81ecc81a-f90e-4477-8474-121cfc13202e req-51c8e717-fb7f-4aef-b231-f5e4102c462f service nova] [instance: 52a44464-e0d3-4620-9d54-37fd4d82d32c] Received event network-vif-deleted-3553e048-612e-49d7-8cdb-6cf7a4107f5b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:33:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:33:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:33:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7816MB free_disk=25.164440155029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6352329f-a8ce-4008-b736-737934dd1b52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:33:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:33:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:33:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:33:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:01 user nova-compute[75073]: INFO nova.compute.manager [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Unrescuing
Nov 24 10:34:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'flavor' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:02 user nova-compute[75073]: WARNING nova.compute.manager [req-cd3a692c-a9af-4dc6-a6e0-2609c03bcb81 req-55d6d2f4-95e5-4deb-be52-968fa4d6db93 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:34:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance destroyed successfully.
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing instance network info cache due to event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:02 user nova-compute[75073]: DEBUG nova.network.neutron [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updated VIF entry in instance network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c08f59aa-a383-4d2b-b4a5-8db5df5e141f req-c2ddd5f6-51f9-4f2a-88d2-cde397089d80 service nova] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:03 user nova-compute[75073]: INFO nova.compute.manager [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Detaching volume bae1ba6f-55b6-47de-bac9-e651345b3c05
Nov 24 10:34:03 user nova-compute[75073]: INFO nova.virt.block_device [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Attempting to driver detach volume bae1ba6f-55b6-47de-bac9-e651345b3c05 from mountpoint /dev/vdb
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Attempting to detach device vdb from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:34:03 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:34:03 user nova-compute[75073]:   <source dev="/dev/sdh"/>
Nov 24 10:34:03 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:34:03 user nova-compute[75073]:   <serial>bae1ba6f-55b6-47de-bac9-e651345b3c05</serial>
Nov 24 10:34:03 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:34:03 user nova-compute[75073]: </disk>
Nov 24 10:34:03 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:34:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully detached device vdb from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the persistent domain config.
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:34:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:34:03 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:34:03 user nova-compute[75073]:   <source dev="/dev/sdh"/>
Nov 24 10:34:03 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:34:03 user nova-compute[75073]:   <serial>bae1ba6f-55b6-47de-bac9-e651345b3c05</serial>
Nov 24 10:34:03 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:34:03 user nova-compute[75073]: </disk>
Nov 24 10:34:03 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:04 user nova-compute[75073]: WARNING nova.compute.manager [req-5ae90563-3d8f-450c-93da-755f03448573 req-a4bc66b9-7309-4947-9975-c515773eb300 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:34:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing instance network info cache due to event network-changed-dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] Acquiring lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] Acquired lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Refreshing network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updated VIF entry in instance network info cache for port dd74395e-1c17-4c29-b311-7457e29711ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [{"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-15a55319-4757-406b-a823-ba881ca86b41 req-5ada3f05-0637-4565-988e-b0b11ec2b6a8 service nova] Releasing lock "refresh_cache-22994ffd-5bf9-460c-a04a-2b206c7fd02f" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:06 user nova-compute[75073]: WARNING nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:34:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:06 user nova-compute[75073]: WARNING nova.compute.manager [req-ded57a53-92c6-4a76-b64b-3b77e05d0b2f req-989bc48f-095f-4adc-8478-6f2fdf3ccdee service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:34:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-fbb34195-ffc5-4e0f-bf08-f3210249f5a6 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:34:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:34:15 user nova-compute[75073]: INFO nova.compute.claims [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Claim successful on node user
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:34:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:34:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.policy [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c5754304104fec9f1af3afc52e6f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99debe1b1a2443eba2f955911465f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:34:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Creating image(s)
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "/opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk 1073741824" returned: 0 in 0.062s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Successfully created port: 8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.202s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Cannot resize image /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Ensure instance console log exists: /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Successfully updated port: 8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-changed-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Refreshing instance network info cache due to event network-changed-8f723fb9-078b-4ccc-b678-ed2649e9fdca. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] Acquiring lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updating instance_info_cache with network_info: [{"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Instance network_info: |[{"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] Acquired lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Refreshing network info cache for port 8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Start _get_guest_xml network_info=[{"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:34:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:34:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-286272946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-286272946',id=23,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-pjr6n64h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:34:16Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=20f8c036-492d-4389-bffb-7b6e5c120f39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.objects.instance [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid 20f8c036-492d-4389-bffb-7b6e5c120f39 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:34:17 user nova-compute[75073]:   <uuid>20f8c036-492d-4389-bffb-7b6e5c120f39</uuid>
Nov 24 10:34:17 user nova-compute[75073]:   <name>instance-00000017</name>
Nov 24 10:34:17 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:34:17 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:34:17 user nova-compute[75073]:   <metadata>
Nov 24 10:34:17 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:34:17 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-286272946</nova:name>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:34:17</nova:creationTime>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:34:17 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:34:17 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:owner>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:34:17 user nova-compute[75073]:       </nova:owner>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:34:17 user nova-compute[75073]:       <nova:ports>
Nov 24 10:34:17 user nova-compute[75073]:         <nova:port uuid="8f723fb9-078b-4ccc-b678-ed2649e9fdca">
Nov 24 10:34:17 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 10:34:17 user nova-compute[75073]:         </nova:port>
Nov 24 10:34:17 user nova-compute[75073]:       </nova:ports>
Nov 24 10:34:17 user nova-compute[75073]:     </nova:instance>
Nov 24 10:34:17 user nova-compute[75073]:   </metadata>
Nov 24 10:34:17 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:34:17 user nova-compute[75073]:     <system>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="serial">20f8c036-492d-4389-bffb-7b6e5c120f39</entry>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="uuid">20f8c036-492d-4389-bffb-7b6e5c120f39</entry>
Nov 24 10:34:17 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:34:17 user nova-compute[75073]:     </system>
Nov 24 10:34:17 user nova-compute[75073]:   </sysinfo>
Nov 24 10:34:17 user nova-compute[75073]:   <os>
Nov 24 10:34:17 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:34:17 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:34:17 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:34:17 user nova-compute[75073]:   </os>
Nov 24 10:34:17 user nova-compute[75073]:   <features>
Nov 24 10:34:17 user nova-compute[75073]:     <acpi/>
Nov 24 10:34:17 user nova-compute[75073]:     <apic/>
Nov 24 10:34:17 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:34:17 user nova-compute[75073]:   </features>
Nov 24 10:34:17 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:34:17 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:34:17 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:34:17 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:34:17 user nova-compute[75073]:   </clock>
Nov 24 10:34:17 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:34:17 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:34:17 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:34:17 user nova-compute[75073]:   </cpu>
Nov 24 10:34:17 user nova-compute[75073]:   <devices>
Nov 24 10:34:17 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:34:17 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:34:17 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk"/>
Nov 24 10:34:17 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:34:17 user nova-compute[75073]:     </disk>
Nov 24 10:34:17 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:34:17 user nova-compute[75073]:       <mac address="fa:16:3e:58:2b:80"/>
Nov 24 10:34:17 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:34:17 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:34:17 user nova-compute[75073]:       <target dev="tap8f723fb9-07"/>
Nov 24 10:34:17 user nova-compute[75073]:     </interface>
Nov 24 10:34:17 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:34:17 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/console.log" append="off"/>
Nov 24 10:34:17 user nova-compute[75073]:     </serial>
Nov 24 10:34:17 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:34:17 user nova-compute[75073]:     <video>
Nov 24 10:34:17 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:34:17 user nova-compute[75073]:     </video>
Nov 24 10:34:17 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:34:17 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:34:17 user nova-compute[75073]:     </rng>
Nov 24 10:34:17 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:34:17 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:34:17 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:34:17 user nova-compute[75073]:     </memballoon>
Nov 24 10:34:17 user nova-compute[75073]:   </devices>
Nov 24 10:34:17 user nova-compute[75073]: </domain>
Nov 24 10:34:17 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-286272946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-286272946',id=23,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-pjr6n64h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:34:16Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=20f8c036-492d-4389-bffb-7b6e5c120f39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG os_vif [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4d5276c-4eca-5119-b98c-8653dd36bc80', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f723fb9-07, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f723fb9-07, col_values=(('qos', UUID('088ece0c-39dc-433e-8302-dacbb3a29803')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f723fb9-07, col_values=(('external_ids', {'iface-id': '8f723fb9-078b-4ccc-b678-ed2649e9fdca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:2b:80', 'vm-uuid': '20f8c036-492d-4389-bffb-7b6e5c120f39'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:17 user nova-compute[75073]: INFO os_vif [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07')
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:58:2b:80, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updated VIF entry in instance network info cache for port 8f723fb9-078b-4ccc-b678-ed2649e9fdca. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updating instance_info_cache with network_info: [{"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c87a6ad2-1d29-494c-9780-fa0ed534d1ac req-09207e05-1ee0-42ed-a15b-217232368569 service nova] Releasing lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] No waiting events found dispatching network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:19 user nova-compute[75073]: WARNING nova.compute.manager [req-7ab17eda-70c8-4e45-b0a3-25c384db31d8 req-3f1fc523-8fd2-46f9-a50d-350f6a89ad47 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received unexpected event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca for instance with vm_state building and task_state spawning.
Nov 24 10:34:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:34:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Instance spawned successfully.
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] No waiting events found dispatching network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:21 user nova-compute[75073]: WARNING nova.compute.manager [req-2df73e91-7793-40c7-8a78-751d625943c3 req-dffca11f-a629-4c35-a435-36e532e9f2d7 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received unexpected event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca for instance with vm_state building and task_state spawning.
Nov 24 10:34:21 user nova-compute[75073]: INFO nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 24 10:34:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:34:21 user nova-compute[75073]: INFO nova.compute.manager [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Took 6.43 seconds to build instance.
Nov 24 10:34:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-74a8a5eb-1685-4b64-9563-d6d60d3e4451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.523s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 is timed out.
Nov 24 10:34:24 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully detached device vdb from instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 from the live domain config.
Nov 24 10:34:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpaEPhVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:34:24 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d857ff-770e-4e6e-94f1-6fd0bace6b30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:34:24 user nova-compute[75073]: No targets found.
Nov 24 10:34:24 user nova-compute[75073]: iSNS:
Nov 24 10:34:24 user nova-compute[75073]: No targets found.
Nov 24 10:34:24 user nova-compute[75073]: STATIC:
Nov 24 10:34:24 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05
Nov 24 10:34:24 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:24 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:24 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:34:24 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:24 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:24 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:34:24 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:24 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:24 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:34:24 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:24 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:24 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:34:24 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:24 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:24 user nova-compute[75073]: FIRMWARE:
Nov 24 10:34:24 user nova-compute[75073]: No targets found.
Nov 24 10:34:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:34:24 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:34:24 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe3add-a457-4977-a5ec-73b4c9c669ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dede2b4-d760-4433-b3ee-f5dc077547e6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 (non-flash)
Nov 24 10:34:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382cf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05'): ({'sdh'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Removing single pathed devices sdh {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3110d22-a3c2-4c3b-b238-920b2a27d4dc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[58048cda-ca4d-46af-9128-b6a4bdfa69cd]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Flushing IO for device /dev/sdh {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfde1be9-6bbc-41df-b28f-d0bf23223795]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:34:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3df779-cefa-445d-be1b-83a33bc13799]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] SCSI volumes sdh have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb214fa-d293-4f97-b605-67c44d258065]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2e2bd-df3e-4fd6-b524-47d089c8f4df]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260]
Nov 24 10:34:25 user nova-compute[75073]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05, portal: 172.16.0.220,3260] successful.
Nov 24 10:34:25 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bae1ba6f-55b6-47de-bac9-e651345b3c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[43663a16-6414-4714-89b2-787a4e18cf0f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] <== disconnect_volume: return (349ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:25 user nova-compute[75073]: INFO nova.compute.manager [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Terminating instance
Nov 24 10:34:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'flavor' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f67c3e01-222a-42cc-83f3-881d374e6349 tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.569s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-54d9b90e-f52a-4d01-bc28-0db18f1e1668 req-0d0f870f-eb9a-4c0d-a489-df095002d89f service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-unplugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:34:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Instance destroyed successfully.
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lazy-loading 'resources' on Instance uuid 6352329f-a8ce-4008-b736-737934dd1b52 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1321166727',display_name='tempest-ServerActionsTestOtherB-server-1321166727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1321166727',id=15,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyY9miiQ51RAYSl6movFK9cjlhcASxEuOriJhdVLQO66CaOSSVnjFBSyGn8LCnMmNXb3GMmzsjH7TilXX0R9Oz3OmoUYhtLtvd+fZKYIDsw5CAO4dxQwE9XSNitakqLqQ==',key_name='tempest-keypair-770013475',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='496d4b08c8784b6b8afeb105d7fef10f',ramdisk_id='',reservation_id='r-y2yvrniy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1373511819',owner_user_name='tempest-ServerActionsTestOtherB-1373511819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42d05b01c17a48aa93bcd7a4078332d7',uuid=6352329f-a8ce-4008-b736-737934dd1b52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converting VIF {"id": "2345385d-d91c-4da6-b345-9216c98a05c2", "address": "fa:16:3e:74:2d:dc", "network": {"id": "3ec4128d-2fce-41db-9ffe-cb298bbb2409", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-250568375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496d4b08c8784b6b8afeb105d7fef10f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2345385d-d9", "ovs_interfaceid": "2345385d-d91c-4da6-b345-9216c98a05c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_vif [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2345385d-d9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6df2fed-62d6-4908-a3c6-41093a782856) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:26 user nova-compute[75073]: INFO os_vif [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:2d:dc,bridge_name='br-int',has_traffic_filtering=True,id=2345385d-d91c-4da6-b345-9216c98a05c2,network=Network(3ec4128d-2fce-41db-9ffe-cb298bbb2409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2345385d-d9')
Nov 24 10:34:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnKwdRpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:34:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[840203aa-73ff-4a6e-8947-d82c980c0655]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:34:26 user nova-compute[75073]: No targets found.
Nov 24 10:34:26 user nova-compute[75073]: iSNS:
Nov 24 10:34:26 user nova-compute[75073]: No targets found.
Nov 24 10:34:26 user nova-compute[75073]: STATIC:
Nov 24 10:34:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:34:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:34:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:34:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a
Nov 24 10:34:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:26 user nova-compute[75073]: FIRMWARE:
Nov 24 10:34:26 user nova-compute[75073]: No targets found.
Nov 24 10:34:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:34:26 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:34:26 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c1930-c31a-45a8-afe4-b85d6b54e881]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e253dac2-7bfe-4b7d-ac65-57c77608a0dc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a (non-flash)
Nov 24 10:34:27 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402bd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb98953-81bc-43b2-bb19-3356b1c3fcb3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d7adc7-def3-432c-a28e-c4ff8b87eff9]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e90427-c97e-4a69-9820-1527cf13a809]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[463756ab-b8ea-4292-9002-b9ca53114ab3]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[159fc907-5a70-4280-a4f4-0ee11b2be0ae]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98381b1-8562-4401-b4df-7e83a34394c8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260]
Nov 24 10:34:27 user nova-compute[75073]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a, portal: 172.16.0.220,3260] successful.
Nov 24 10:34:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ce071a-87ca-4e08-aade-46e7e26fd53a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d50f26e-7051-4387-b876-53c1ff3f21ff]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] <== disconnect_volume: return (315ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:34:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Deleting instance files /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_del
Nov 24 10:34:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Deletion of /opt/stack/data/nova/instances/6352329f-a8ce-4008-b736-737934dd1b52_del complete
Nov 24 10:34:27 user nova-compute[75073]: INFO nova.compute.manager [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 24 10:34:27 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:34:27 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:28 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Took 0.75 seconds to deallocate network for instance.
Nov 24 10:34:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] Acquiring lock "6352329f-a8ce-4008-b736-737934dd1b52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] Lock "6352329f-a8ce-4008-b736-737934dd1b52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] No waiting events found dispatching network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:28 user nova-compute[75073]: WARNING nova.compute.manager [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received unexpected event network-vif-plugged-2345385d-d91c-4da6-b345-9216c98a05c2 for instance with vm_state active and task_state deleting.
Nov 24 10:34:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca48d0a9-f1e4-4b3b-a17d-cb1b915958c9 req-3dd58705-c35b-40e3-9713-cd16b563f9ed service nova] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Received event network-vif-deleted-2345385d-d91c-4da6-b345-9216c98a05c2 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:28 user nova-compute[75073]: INFO nova.compute.manager [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] [instance: 6352329f-a8ce-4008-b736-737934dd1b52] Took 0.76 seconds to detach 1 volumes for instance.
Nov 24 10:34:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:29 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:34:29 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:34:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:29 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Deleted allocations for instance 6352329f-a8ce-4008-b736-737934dd1b52
Nov 24 10:34:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1fa5e78a-3c00-4870-ab31-ecb6e76298af tempest-ServerActionsTestOtherB-1373511819 tempest-ServerActionsTestOtherB-1373511819-project-member] Lock "6352329f-a8ce-4008-b736-737934dd1b52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.663s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:34 user nova-compute[75073]: INFO nova.compute.manager [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Detaching volume e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:34:34 user nova-compute[75073]: INFO nova.virt.block_device [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Attempting to driver detach volume e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 from mountpoint /dev/vdb
Nov 24 10:34:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Attempting to detach device vdb from instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:34:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:34:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:34:34 user nova-compute[75073]:   <source dev="/dev/sdg"/>
Nov 24 10:34:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:34:34 user nova-compute[75073]:   <serial>e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196</serial>
Nov 24 10:34:34 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:34:34 user nova-compute[75073]: </disk>
Nov 24 10:34:34 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:34:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Successfully detached device vdb from instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f from the persistent domain config.
Nov 24 10:34:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:34:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:34:35 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:34:35 user nova-compute[75073]:   <source dev="/dev/sdg"/>
Nov 24 10:34:35 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:34:35 user nova-compute[75073]:   <serial>e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196</serial>
Nov 24 10:34:35 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:34:35 user nova-compute[75073]: </disk>
Nov 24 10:34:35 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:34:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:34:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:34:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:34:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:34:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8026MB free_disk=25.189250946044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:34:47 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:34:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:34:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:34:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:54 user nova-compute[75073]: INFO nova.compute.manager [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Terminating instance
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-unplugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] No waiting events found dispatching network-vif-unplugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-a9463529-b78c-477e-a97e-71754d547d66 req-279951e7-8c27-4418-b262-670b7f6ffa35 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-unplugged-67c860c4-a227-4aea-9577-af4e7d509c90 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Instance destroyed successfully.
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.objects.instance [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lazy-loading 'resources' on Instance uuid 8e2966a4-412c-4a3c-befd-31cfa17a77d7 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-857652970',display_name='tempest-TestServerVolumeAttachmentScenario-server-857652970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-857652970',id=22,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgVrjcr5x8tC5X4WEB8HSXYYS/lEmAuBiTZZCRpRCOSmKJqlOXC72sQ7ANyfK0Eb7UYdWHKzC6w8nBHtN5POnn9ZdKCw6tfFE4GxopKI4D/8qWBvP/u3sqoYezYUhB7HQ==',key_name='tempest-keypair-680494624',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3f6a908740a4a628e63485b71dc0e50',ramdisk_id='',reservation_id='r-r8plopn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2121002479',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2121002479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76623c68b4234fc3b4b1d7ceedd7044c',uuid=8e2966a4-412c-4a3c-befd-31cfa17a77d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converting VIF {"id": "67c860c4-a227-4aea-9577-af4e7d509c90", "address": "fa:16:3e:5f:26:d6", "network": {"id": "dae4cfa3-fb09-4493-bd2a-60cf325c7ec3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1406138204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f6a908740a4a628e63485b71dc0e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c860c4-a2", "ovs_interfaceid": "67c860c4-a227-4aea-9577-af4e7d509c90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG os_vif [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67c860c4-a2, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61e4e1a3-0ea2-464c-a4ff-0c200e6698e2) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:34:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:34:54 user nova-compute[75073]: INFO os_vif [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:26:d6,bridge_name='br-int',has_traffic_filtering=True,id=67c860c4-a227-4aea-9577-af4e7d509c90,network=Network(dae4cfa3-fb09-4493-bd2a-60cf325c7ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67c860c4-a2')
Nov 24 10:34:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Deleting instance files /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7_del
Nov 24 10:34:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Deletion of /opt/stack/data/nova/instances/8e2966a4-412c-4a3c-befd-31cfa17a77d7_del complete
Nov 24 10:34:55 user nova-compute[75073]: INFO nova.compute.manager [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:34:55 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f is timed out.
Nov 24 10:34:55 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Successfully detached device vdb from instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f from the live domain config.
Nov 24 10:34:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONbuxKsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:34:55 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f68b449-4c61-4d78-8a8d-4770939de500]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:34:55 user nova-compute[75073]: No targets found.
Nov 24 10:34:55 user nova-compute[75073]: iSNS:
Nov 24 10:34:55 user nova-compute[75073]: No targets found.
Nov 24 10:34:55 user nova-compute[75073]: STATIC:
Nov 24 10:34:55 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196
Nov 24 10:34:55 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:55 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:55 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:34:55 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:55 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:55 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:34:55 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:34:55 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:34:55 user nova-compute[75073]: FIRMWARE:
Nov 24 10:34:55 user nova-compute[75073]: No targets found.
Nov 24 10:34:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:34:55 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:34:55 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc1b70-6da4-4428-9d26-907b3910a9b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f07bc0-8bdf-4271-9eb3-24125451c958]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:55 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:55 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:34:55 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:34:55 user nova-compute[75073]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 (non-flash)
Nov 24 10:34:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382184c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196'): ({'sdg'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Removing single pathed devices sdg {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[053df806-4f2a-4979-abd9-c6678fadfece]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1eff8-c547-4fc3-b245-ee047c69121b]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Flushing IO for device /dev/sdg {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235ffaa-4f04-4fd8-8835-efd909fabde8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0534e9-df30-4505-8049-51e97129bc48]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ecee6e-4ba7-427d-9718-46571465fdf6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f8894-0f02-4c58-9b58-52f40b27f74f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260]
Nov 24 10:34:55 user nova-compute[75073]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196, portal: 172.16.0.220,3260] successful.
Nov 24 10:34:55 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:34:55 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Took 0.75 seconds to deallocate network for instance.
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70adcf1-77bf-4a0a-8d6b-3e3fcb1ae196 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7e034-c5a4-48db-881f-0e77fdcf4bc6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] <== disconnect_volume: return (349ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:56 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Deleted allocations for instance 8e2966a4-412c-4a3c-befd-31cfa17a77d7
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-eb13365f-3656-4f7f-b5cd-40182bac011e tempest-TestServerVolumeAttachmentScenario-2121002479 tempest-TestServerVolumeAttachmentScenario-2121002479-project-member] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.098s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'flavor' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] Acquiring lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] Lock "8e2966a4-412c-4a3c-befd-31cfa17a77d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] No waiting events found dispatching network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:34:56 user nova-compute[75073]: WARNING nova.compute.manager [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received unexpected event network-vif-plugged-67c860c4-a227-4aea-9577-af4e7d509c90 for instance with vm_state deleted and task_state None.
Nov 24 10:34:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-45167adf-e7c7-41d0-9448-29d0f3eda0bf req-4ce9953a-5dd7-42cd-9d05-5f9d0d715cd5 service nova] [instance: 8e2966a4-412c-4a3c-befd-31cfa17a77d7] Received event network-vif-deleted-67c860c4-a227-4aea-9577-af4e7d509c90 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:34:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-85403efd-3238-4cf0-b872-bc8add12a8e0 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.667s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:34:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing instance network info cache due to event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:35:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:00 user nova-compute[75073]: DEBUG nova.network.neutron [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.network.neutron [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updated VIF entry in instance network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.network.neutron [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d8e9b903-41d2-44a3-b471-6222f35669ba req-65995615-0ec4-46e3-b284-f3aa792d88b9 service nova] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:01 user nova-compute[75073]: INFO nova.compute.manager [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Detaching volume 6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:35:01 user nova-compute[75073]: INFO nova.virt.block_device [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Attempting to driver detach volume 6f0b98b9-df3c-43e6-a5aa-e1839e900da3 from mountpoint /dev/vdb
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Attempting to detach device vdb from instance c5d379dd-cc6c-41f0-b5e7-bc576129943a from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:35:01 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:35:01 user nova-compute[75073]:   <source dev="/dev/sde"/>
Nov 24 10:35:01 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:35:01 user nova-compute[75073]:   <serial>6f0b98b9-df3c-43e6-a5aa-e1839e900da3</serial>
Nov 24 10:35:01 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:35:01 user nova-compute[75073]: </disk>
Nov 24 10:35:01 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:35:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully detached device vdb from instance c5d379dd-cc6c-41f0-b5e7-bc576129943a from the persistent domain config.
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5d379dd-cc6c-41f0-b5e7-bc576129943a from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:35:01 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:35:01 user nova-compute[75073]:   <source dev="/dev/sde"/>
Nov 24 10:35:01 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:35:01 user nova-compute[75073]:   <serial>6f0b98b9-df3c-43e6-a5aa-e1839e900da3</serial>
Nov 24 10:35:01 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:35:01 user nova-compute[75073]: </disk>
Nov 24 10:35:01 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:35:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing instance network info cache due to event network-changed-788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] Acquiring lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] Acquired lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:02 user nova-compute[75073]: DEBUG nova.network.neutron [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Refreshing network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:35:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updated VIF entry in instance network info cache for port 788218bb-1988-4aed-95a1-b144fa414dc0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:35:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [{"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-82ebc364-aa23-4af8-92ce-a2418d3bea6d req-9c44ebba-3649-44be-b7ee-ac8ad62ca856 service nova] Releasing lock "refresh_cache-c5d379dd-cc6c-41f0-b5e7-bc576129943a" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:35:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:21 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5d379dd-cc6c-41f0-b5e7-bc576129943a is timed out.
Nov 24 10:35:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully detached device vdb from instance c5d379dd-cc6c-41f0-b5e7-bc576129943a from the live domain config.
Nov 24 10:35:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWuhJzyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:35:21 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f124cc-f9be-4379-8d0f-2777bb94ea9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:35:21 user nova-compute[75073]: No targets found.
Nov 24 10:35:21 user nova-compute[75073]: iSNS:
Nov 24 10:35:21 user nova-compute[75073]: No targets found.
Nov 24 10:35:21 user nova-compute[75073]: STATIC:
Nov 24 10:35:21 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:35:21 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:35:21 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:35:21 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3
Nov 24 10:35:21 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:35:21 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:35:21 user nova-compute[75073]: FIRMWARE:
Nov 24 10:35:21 user nova-compute[75073]: No targets found.
Nov 24 10:35:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:35:21 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:35:21 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d4b25d-52a5-4d4a-bac3-cb223d8fa375]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[02289716-4ae0-47d1-be86-441d0358cd66]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:21 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:35:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:21 user nova-compute[75073]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 (non-flash)
Nov 24 10:35:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23864a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3'): ({'sde'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Removing single pathed devices sde {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e43e2d6-eaf4-4aa9-a79c-ccf0ade847dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[327df1c2-4c87-46df-913e-0b7071232e16]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Flushing IO for device /dev/sde {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae9641-97f5-4430-8157-c3fcb574163d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4593139-c203-4099-bcda-3c66a0d7a9bc]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8c0da0-7cef-4815-8603-ec57a9a6058c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d9cd73-6448-4015-911e-74db7cc6622a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260]
Nov 24 10:35:21 user nova-compute[75073]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3, portal: 172.16.0.220,3260] successful.
Nov 24 10:35:21 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0b98b9-df3c-43e6-a5aa-e1839e900da3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb313639-f502-46f7-b08c-4b85c9b4fe74]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] <== disconnect_volume: return (298ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:35:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:35:22 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'flavor' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:35:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d3852858-52d2-486e-a543-44cab6aa4b37 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:25 user nova-compute[75073]: INFO nova.compute.manager [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Terminating instance
Nov 24 10:35:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-b126aa4b-fc43-448c-b402-6f01baddbc69 req-bf2cc6ab-cb7c-42f8-9470-8d271413b21d service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-unplugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:35:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Instance destroyed successfully.
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lazy-loading 'resources' on Instance uuid 22994ffd-5bf9-460c-a04a-2b206c7fd02f {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-950738275',display_name='tempest-ServerStableDeviceRescueTest-server-950738275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-950738275',id=19,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdZ5PWkX8bfykVY2l8KJWvIRywALd2orQ4pyUssBpDc23j4tCwwoKXQPogM4FIiMY3nqQSfZEej4LrqxQcCWnpAHgsx6N6SG/7v4/Lax41EvxzA/qM/TFD6uwDG0mqLLw==',key_name='tempest-keypair-1817962517',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b3012c563042da9cf3f61dac69d570',ramdisk_id='',reservation_id='r-wryojn74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-987992993',owner_user_name='tempest-ServerStableDeviceRescueTest-987992993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e945ba41be374114af0acb30cea23c96',uuid=22994ffd-5bf9-460c-a04a-2b206c7fd02f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converting VIF {"id": "dd74395e-1c17-4c29-b311-7457e29711ea", "address": "fa:16:3e:a0:c7:70", "network": {"id": "bc85a5f1-8188-4bc7-aee9-6820486ba578", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1333217604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b3012c563042da9cf3f61dac69d570", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd74395e-1c", "ovs_interfaceid": "dd74395e-1c17-4c29-b311-7457e29711ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG os_vif [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd74395e-1c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f5577bd-db7b-4157-86f0-9aea20c494bd) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:26 user nova-compute[75073]: INFO os_vif [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=dd74395e-1c17-4c29-b311-7457e29711ea,network=Network(bc85a5f1-8188-4bc7-aee9-6820486ba578),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd74395e-1c')
Nov 24 10:35:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Deleting instance files /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f_del
Nov 24 10:35:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Deletion of /opt/stack/data/nova/instances/22994ffd-5bf9-460c-a04a-2b206c7fd02f_del complete
Nov 24 10:35:26 user nova-compute[75073]: INFO nova.compute.manager [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 10:35:26 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:35:26 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:35:27 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:27 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Took 0.93 seconds to deallocate network for instance.
Nov 24 10:35:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:27 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:35:27 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:35:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:28 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Deleted allocations for instance 22994ffd-5bf9-460c-a04a-2b206c7fd02f
Nov 24 10:35:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] Acquiring lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] No waiting events found dispatching network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:28 user nova-compute[75073]: WARNING nova.compute.manager [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received unexpected event network-vif-plugged-dd74395e-1c17-4c29-b311-7457e29711ea for instance with vm_state deleted and task_state None.
Nov 24 10:35:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d9f091fe-1a6a-4deb-a712-77f600d817ef req-1de22213-9581-41bd-9bf7-3ea99e82d4e5 service nova] [instance: 22994ffd-5bf9-460c-a04a-2b206c7fd02f] Received event network-vif-deleted-dd74395e-1c17-4c29-b311-7457e29711ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9423527c-f0e2-42a1-b606-cd661363e211 tempest-ServerStableDeviceRescueTest-987992993 tempest-ServerStableDeviceRescueTest-987992993-project-member] Lock "22994ffd-5bf9-460c-a04a-2b206c7fd02f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:35:32 user nova-compute[75073]: INFO nova.compute.claims [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Claim successful on node user
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:35:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:35:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.policy [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '288a86b67b4f449faffbbfe208a2effe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800195c134fc45b892777e8d8e1cb13e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:35:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Creating image(s)
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk 1073741824" returned: 0 in 0.049s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Successfully created port: 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Cannot resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Ensure instance console log exists: /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Successfully updated port: 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-changed-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Refreshing instance network info cache due to event network-changed-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance network_info: |[{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Refreshing network info cache for port 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start _get_guest_xml network_info=[{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:35:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'pci_devices' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:35:34 user nova-compute[75073]:   <uuid>d619711b-81f7-4a70-96a3-380c5f4b99be</uuid>
Nov 24 10:35:34 user nova-compute[75073]:   <name>instance-00000018</name>
Nov 24 10:35:34 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:35:34 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:35:34 user nova-compute[75073]:   <metadata>
Nov 24 10:35:34 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:35:34 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeTestJSON-server-2047909114</nova:name>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:35:34</nova:creationTime>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:35:34 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:35:34 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:owner>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:user uuid="288a86b67b4f449faffbbfe208a2effe">tempest-AttachVolumeTestJSON-729242413-project-member</nova:user>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:project uuid="800195c134fc45b892777e8d8e1cb13e">tempest-AttachVolumeTestJSON-729242413</nova:project>
Nov 24 10:35:34 user nova-compute[75073]:       </nova:owner>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:35:34 user nova-compute[75073]:       <nova:ports>
Nov 24 10:35:34 user nova-compute[75073]:         <nova:port uuid="5b97624e-3d6d-48d3-8a02-50e9d17bb5c0">
Nov 24 10:35:34 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:35:34 user nova-compute[75073]:         </nova:port>
Nov 24 10:35:34 user nova-compute[75073]:       </nova:ports>
Nov 24 10:35:34 user nova-compute[75073]:     </nova:instance>
Nov 24 10:35:34 user nova-compute[75073]:   </metadata>
Nov 24 10:35:34 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:35:34 user nova-compute[75073]:     <system>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="serial">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="uuid">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:35:34 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:35:34 user nova-compute[75073]:     </system>
Nov 24 10:35:34 user nova-compute[75073]:   </sysinfo>
Nov 24 10:35:34 user nova-compute[75073]:   <os>
Nov 24 10:35:34 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:35:34 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:35:34 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:35:34 user nova-compute[75073]:   </os>
Nov 24 10:35:34 user nova-compute[75073]:   <features>
Nov 24 10:35:34 user nova-compute[75073]:     <acpi/>
Nov 24 10:35:34 user nova-compute[75073]:     <apic/>
Nov 24 10:35:34 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:35:34 user nova-compute[75073]:   </features>
Nov 24 10:35:34 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:35:34 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:35:34 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:35:34 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:35:34 user nova-compute[75073]:   </clock>
Nov 24 10:35:34 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:35:34 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:35:34 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:35:34 user nova-compute[75073]:   </cpu>
Nov 24 10:35:34 user nova-compute[75073]:   <devices>
Nov 24 10:35:34 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:35:34 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:35:34 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk"/>
Nov 24 10:35:34 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:35:34 user nova-compute[75073]:     </disk>
Nov 24 10:35:34 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:35:34 user nova-compute[75073]:       <mac address="fa:16:3e:d0:fd:eb"/>
Nov 24 10:35:34 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:35:34 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:35:34 user nova-compute[75073]:       <target dev="tap5b97624e-3d"/>
Nov 24 10:35:34 user nova-compute[75073]:     </interface>
Nov 24 10:35:34 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:35:34 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/console.log" append="off"/>
Nov 24 10:35:34 user nova-compute[75073]:     </serial>
Nov 24 10:35:34 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:35:34 user nova-compute[75073]:     <video>
Nov 24 10:35:34 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:35:34 user nova-compute[75073]:     </video>
Nov 24 10:35:34 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:35:34 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:35:34 user nova-compute[75073]:     </rng>
Nov 24 10:35:34 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:35:34 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:35:34 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:35:34 user nova-compute[75073]:     </memballoon>
Nov 24 10:35:34 user nova-compute[75073]:   </devices>
Nov 24 10:35:34 user nova-compute[75073]: </domain>
Nov 24 10:35:34 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG os_vif [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '747ebf20-7d60-5943-ae3e-a4059238f4d6', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b97624e-3d, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b97624e-3d, col_values=(('qos', UUID('100cfc35-44db-4266-8f2b-5df48ff33ae5')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b97624e-3d, col_values=(('external_ids', {'iface-id': '5b97624e-3d6d-48d3-8a02-50e9d17bb5c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fd:eb', 'vm-uuid': 'd619711b-81f7-4a70-96a3-380c5f4b99be'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:34 user nova-compute[75073]: INFO os_vif [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No VIF found with MAC fa:16:3e:d0:fd:eb, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updated VIF entry in instance network info cache for port 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bb8e5a77-f69f-4358-8d91-a24dec033673 req-7095583c-1d13-409b-8f5d-b4d8927a8edd service nova] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:36 user nova-compute[75073]: WARNING nova.compute.manager [req-5b20efad-cbdd-46f5-9724-bda04966cf4d req-6e64700d-3157-4b42-a8c9-454c49ab1210 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state building and task_state spawning.
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:35:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance spawned successfully.
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:38 user nova-compute[75073]: WARNING nova.compute.manager [req-dad5ccac-e14d-41cd-89bd-4d95a63b49db req-2671d460-69f1-4019-80a2-4613e358946c service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state building and task_state spawning.
Nov 24 10:35:38 user nova-compute[75073]: INFO nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 24 10:35:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:35:38 user nova-compute[75073]: INFO nova.compute.manager [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Took 5.87 seconds to build instance.
Nov 24 10:35:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ef7309f-b768-40f2-bd5b-7f3b7d586f84 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.980s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:35:42 user nova-compute[75073]: INFO nova.compute.claims [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Claim successful on node user
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:35:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.policy [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dffd5f6353e344aa96a97235372632fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4665d407280c4667beadb1678e105480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:35:43 user nova-compute[75073]: INFO nova.virt.block_device [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Booting with volume 18e2867b-9aad-4550-b379-d1f7b5419069 at /dev/vda
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.utils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca72744-1121-4a0e-b750-875525e066f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa17c70-d9f9-440b-882d-c94e4d0e0988]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445b6e6-99c4-4f64-9886-b88241e41344]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[083444cd-0710-4468-843e-c8f32004e9f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:35:43 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80f7cf-a802-4c46-af38-7e78181e8ec7]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG os_brick.utils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating existing volume attachment record: ef3093b1-dc25-4cf5-a105-076bbbbc5569 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:35:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Successfully created port: 21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Successfully updated port: 21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-changed-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Refreshing instance network info cache due to event network-changed-21d1ddb6-dd66-44bc-b348-cab61370306e. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance network_info: |[{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Refreshing network info cache for port 21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updated VIF entry in instance network info cache for port 21d1ddb6-dd66-44bc-b348-cab61370306e. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3357cb98-94e5-4dec-be01-750dfba95bca req-312b44dc-8b26-4a2a-a62b-b21c3258f3e5 service nova] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:47 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=25.338836669921875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c5d379dd-cc6c-41f0-b5e7-bc576129943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:35:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:35:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:35:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:35:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:35:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:51 user nova-compute[75073]: INFO nova.compute.manager [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Terminating instance
Nov 24 10:35:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-2612aae9-d696-4cad-9fa3-2cbec9788d8e req-4b2ab2ae-a4e5-4b91-b6dc-28b9cb9d9683 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-unplugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:35:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Creating image(s)
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Ensure instance console log exists: /opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start _get_guest_xml network_info=[{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'ef3093b1-dc25-4cf5-a105-076bbbbc5569', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28791ddc-1317-4147-9f52-59177a5c1715', 'attached_at': '', 'detached_at': '', 'volume_id': '18e2867b-9aad-4550-b379-d1f7b5419069', 'serial': '18e2867b-9aad-4550-b379-d1f7b5419069'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:35:52 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:35:52 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:35:52 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc92a2b-8dea-4cc2-af10-822bb100262b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:35:52 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32412e-97eb-4f36-b6a9-7754f654a7db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069] added
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60f452-2d75-43a5-82b5-8be34da707d2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07932e5-41f6-4478-b1e4-7439e80c2502]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CciUmuAH {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CciUmuAH" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a19be6-1515-45d5-90b7-f9cc5b251495]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CciUmuAH'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6d6e23-8a8e-414c-b170-2e3ffa243196]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60bb256-7f3c-48c8-ad1b-b7dfbe5093af]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd30899-155e-4e9b-9cc3-0f24f7f7bd6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]
Nov 24 10:35:52 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Instance destroyed successfully.
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9806ce-b231-4bdc-999f-d922cf5a4494]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.objects.instance [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid c5d379dd-cc6c-41f0-b5e7-bc576129943a {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-914988472',display_name='tempest-ServerRescueNegativeTestJSON-server-914988472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-914988472',id=21,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU72AqiwNWowUgJcgIp0J+/V8VwS3rD/PPSivhlQ6EukvovdepRuIFcaTtCMaL6JZxZlfdD8/RELh7/+lx8qCKeVcqU1xsuRD5EskX2ALCNxc4A/AnVqmyenHV/HZ3HXw==',key_name='tempest-keypair-1322066976',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-7ck7xo3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b4e168f7a8473d8664e9225c867318',uuid=c5d379dd-cc6c-41f0-b5e7-bc576129943a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "788218bb-1988-4aed-95a1-b144fa414dc0", "address": "fa:16:3e:24:44:b9", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788218bb-19", "ovs_interfaceid": "788218bb-1988-4aed-95a1-b144fa414dc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_vif [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap788218bb-19, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d10a46-56a0-4176-bc4d-1724821bee96]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:52 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:35:52 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:35:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6718c356-9211-43d9-aca9-c9b8a51acfdf) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:52 user nova-compute[75073]: INFO os_vif [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:44:b9,bridge_name='br-int',has_traffic_filtering=True,id=788218bb-1988-4aed-95a1-b144fa414dc0,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788218bb-19')
Nov 24 10:35:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Deleting instance files /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a_del
Nov 24 10:35:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Deletion of /opt/stack/data/nova/instances/c5d379dd-cc6c-41f0-b5e7-bc576129943a_del complete
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3d462e-b56c-4485-9a97-b46aa6bc936e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:35:52 user nova-compute[75073]: INFO nova.compute.manager [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 24 10:35:52 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:35:52 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:35:53 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Took 0.88 seconds to deallocate network for instance.
Nov 24 10:35:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26563356362306636', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563356362306636', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'pci_devices' on Instance uuid 28791ddc-1317-4147-9f52-59177a5c1715 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:35:53 user nova-compute[75073]:   <uuid>28791ddc-1317-4147-9f52-59177a5c1715</uuid>
Nov 24 10:35:53 user nova-compute[75073]:   <name>instance-00000019</name>
Nov 24 10:35:53 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:35:53 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:35:53 user nova-compute[75073]:   <metadata>
Nov 24 10:35:53 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:35:53 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:35:53 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherA-server-1558710929</nova:name>
Nov 24 10:35:53 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:35:52</nova:creationTime>
Nov 24 10:35:53 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:35:53 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:35:53 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:35:53 user nova-compute[75073]:       <nova:owner>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:user uuid="dffd5f6353e344aa96a97235372632fd">tempest-ServerActionsTestOtherA-371935856-project-member</nova:user>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:project uuid="4665d407280c4667beadb1678e105480">tempest-ServerActionsTestOtherA-371935856</nova:project>
Nov 24 10:35:53 user nova-compute[75073]:       </nova:owner>
Nov 24 10:35:53 user nova-compute[75073]:       <nova:ports>
Nov 24 10:35:53 user nova-compute[75073]:         <nova:port uuid="21d1ddb6-dd66-44bc-b348-cab61370306e">
Nov 24 10:35:53 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:35:53 user nova-compute[75073]:         </nova:port>
Nov 24 10:35:53 user nova-compute[75073]:       </nova:ports>
Nov 24 10:35:53 user nova-compute[75073]:     </nova:instance>
Nov 24 10:35:53 user nova-compute[75073]:   </metadata>
Nov 24 10:35:53 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:35:53 user nova-compute[75073]:     <system>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="serial">28791ddc-1317-4147-9f52-59177a5c1715</entry>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="uuid">28791ddc-1317-4147-9f52-59177a5c1715</entry>
Nov 24 10:35:53 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:35:53 user nova-compute[75073]:     </system>
Nov 24 10:35:53 user nova-compute[75073]:   </sysinfo>
Nov 24 10:35:53 user nova-compute[75073]:   <os>
Nov 24 10:35:53 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:35:53 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:35:53 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:35:53 user nova-compute[75073]:   </os>
Nov 24 10:35:53 user nova-compute[75073]:   <features>
Nov 24 10:35:53 user nova-compute[75073]:     <acpi/>
Nov 24 10:35:53 user nova-compute[75073]:     <apic/>
Nov 24 10:35:53 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:35:53 user nova-compute[75073]:   </features>
Nov 24 10:35:53 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:35:53 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:35:53 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:35:53 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:35:53 user nova-compute[75073]:   </clock>
Nov 24 10:35:53 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:35:53 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:35:53 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:35:53 user nova-compute[75073]:   </cpu>
Nov 24 10:35:53 user nova-compute[75073]:   <devices>
Nov 24 10:35:53 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:35:53 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:35:53 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:35:53 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:35:53 user nova-compute[75073]:       <serial>18e2867b-9aad-4550-b379-d1f7b5419069</serial>
Nov 24 10:35:53 user nova-compute[75073]:     </disk>
Nov 24 10:35:53 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:35:53 user nova-compute[75073]:       <mac address="fa:16:3e:3f:38:d1"/>
Nov 24 10:35:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:35:53 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:35:53 user nova-compute[75073]:       <target dev="tap21d1ddb6-dd"/>
Nov 24 10:35:53 user nova-compute[75073]:     </interface>
Nov 24 10:35:53 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:35:53 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715/console.log" append="off"/>
Nov 24 10:35:53 user nova-compute[75073]:     </serial>
Nov 24 10:35:53 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:35:53 user nova-compute[75073]:     <video>
Nov 24 10:35:53 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:35:53 user nova-compute[75073]:     </video>
Nov 24 10:35:53 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:35:53 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:35:53 user nova-compute[75073]:     </rng>
Nov 24 10:35:53 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:35:53 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:35:53 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:35:53 user nova-compute[75073]:     </memballoon>
Nov 24 10:35:53 user nova-compute[75073]:   </devices>
Nov 24 10:35:53 user nova-compute[75073]: </domain>
Nov 24 10:35:53 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG os_vif [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34762230-b4d3-5828-99ca-468037e934ab', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d1ddb6-dd, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21d1ddb6-dd, col_values=(('qos', UUID('f989dd4e-cd86-4c78-a96e-b1f30d8d109c')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21d1ddb6-dd, col_values=(('external_ids', {'iface-id': '21d1ddb6-dd66-44bc-b348-cab61370306e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:38:d1', 'vm-uuid': '28791ddc-1317-4147-9f52-59177a5c1715'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:53 user nova-compute[75073]: INFO os_vif [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd')
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:3f:38:d1, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:35:53 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:54 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Deleted allocations for instance c5d379dd-cc6c-41f0-b5e7-bc576129943a
Nov 24 10:35:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-48f98dab-c0f3-4cb2-81e3-774aa95551c9 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] Acquiring lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] Lock "c5d379dd-cc6c-41f0-b5e7-bc576129943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] No waiting events found dispatching network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:54 user nova-compute[75073]: WARNING nova.compute.manager [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received unexpected event network-vif-plugged-788218bb-1988-4aed-95a1-b144fa414dc0 for instance with vm_state deleted and task_state None.
Nov 24 10:35:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-63d6bd37-16dc-440c-8c58-4fe2bdbb350a req-ced500b2-4634-4037-ad6a-11190b39b336 service nova] [instance: c5d379dd-cc6c-41f0-b5e7-bc576129943a] Received event network-vif-deleted-788218bb-1988-4aed-95a1-b144fa414dc0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:56 user nova-compute[75073]: WARNING nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state building and task_state spawning.
Nov 24 10:35:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:35:56 user nova-compute[75073]: WARNING nova.compute.manager [req-fdc0d7b6-24d6-46c4-8453-9a95676eb74b req-46e274f9-ff9f-4fc9-ab18-4bad921e88e8 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state building and task_state spawning.
Nov 24 10:35:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:35:57 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance spawned successfully.
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:35:57 user nova-compute[75073]: INFO nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 24 10:35:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:35:57 user nova-compute[75073]: INFO nova.compute.manager [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Took 14.64 seconds to build instance.
Nov 24 10:35:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1a7a35e7-302d-4134-ad70-00b48a0fdc3a tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.736s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:35:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:36:06 user nova-compute[75073]: INFO nova.compute.manager [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] instance snapshotting
Nov 24 10:36:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Beginning live snapshot process
Nov 24 10:36:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971.delta 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971.delta 1073741824" returned: 0 in 0.092s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:07 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 10:36:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:36:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 10:36:08 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 10:36:08 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:36:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971.delta /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971.delta /opt/stack/data/nova/instances/snapshots/tmpig5b5sy9/86a919606bd24d2b9114457e21b5b971" returned: 0 in 0.454s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Snapshot extracted, beginning image upload
Nov 24 10:36:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Snapshot image upload complete
Nov 24 10:36:11 user nova-compute[75073]: INFO nova.compute.manager [None req-122f084e-0d99-4152-b079-66743a8a6451 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Took 5.47 seconds to snapshot the instance on the hypervisor.
Nov 24 10:36:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:36:25 user nova-compute[75073]: INFO nova.compute.claims [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Claim successful on node user
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:36:25 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:36:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:36:25 user nova-compute[75073]: INFO nova.virt.block_device [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Booting with volume snapshot 7db59deb-1762-445e-949a-869e98e43397 at /dev/vda
Nov 24 10:36:26 user nova-compute[75073]: DEBUG nova.policy [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:36:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Successfully created port: 9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Successfully updated port: 9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-changed-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Refreshing instance network info cache due to event network-changed-9c0a2af2-e259-4a00-810b-75728fc55d3d. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] Acquiring lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updating instance_info_cache with network_info: [{"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Instance network_info: |[{"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] Acquired lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:36:27 user nova-compute[75073]: DEBUG nova.network.neutron [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Refreshing network info cache for port 9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:36:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updated VIF entry in instance network info cache for port 9c0a2af2-e259-4a00-810b-75728fc55d3d. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:36:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updating instance_info_cache with network_info: [{"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-71e82d20-f1a3-417f-97e1-c0292afdb435 req-adbf3a25-2d65-49ef-bd30-a924a6c70f6c service nova] Releasing lock "refresh_cache-e126e888-7a3a-4485-8dca-10123710a543" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:36:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:36:30 user nova-compute[75073]: INFO nova.compute.claims [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Claim successful on node user
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:36:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.policy [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7eb1e6d109f94de791496a9d1850d8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eddcf7e79342b596d1f93d456051fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:36:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Creating image(s)
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "/opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "/opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG os_brick.utils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad2114-a877-43eb-9050-4f67870c34c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c16b3-f01c-4f03-9547-9cc2fca3546d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Successfully created port: 81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[743f7563-2f99-4032-b0e8-999a57f0390e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa2d18a-f5fa-4815-9ae6-e1cd80845472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk 1073741824" returned: 0 in 0.088s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:36:32 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d141234-b36a-4fb9-ad59-48d2b25d90af]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG os_brick.utils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updating existing volume attachment record: a57c4399-236d-44f2-88a7-4f4a14ae63a8 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Cannot resize image /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Ensure instance console log exists: /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Successfully updated port: 81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquired lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-changed-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Refreshing instance network info cache due to event network-changed-81d58fe2-1825-4df2-a991-ed9e6632f371. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] Acquiring lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updating instance_info_cache with network_info: [{"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Releasing lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Instance network_info: |[{"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] Acquired lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.network.neutron [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Refreshing network info cache for port 81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Start _get_guest_xml network_info=[{"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:36:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:36:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1542362689',display_name='tempest-ServersNegativeTestJSON-server-1542362689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1542362689',id=27,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-kvhws04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:36:31Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=b0927891-6586-4c71-9c78-d1b5ed8a2a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lazy-loading 'pci_devices' on Instance uuid b0927891-6586-4c71-9c78-d1b5ed8a2a01 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:36:33 user nova-compute[75073]:   <uuid>b0927891-6586-4c71-9c78-d1b5ed8a2a01</uuid>
Nov 24 10:36:33 user nova-compute[75073]:   <name>instance-0000001b</name>
Nov 24 10:36:33 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:36:33 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:36:33 user nova-compute[75073]:   <metadata>
Nov 24 10:36:33 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:36:33 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:name>tempest-ServersNegativeTestJSON-server-1542362689</nova:name>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:36:32</nova:creationTime>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:36:33 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:36:33 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:owner>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:user uuid="7eb1e6d109f94de791496a9d1850d8b6">tempest-ServersNegativeTestJSON-573004776-project-member</nova:user>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:project uuid="e3eddcf7e79342b596d1f93d456051fa">tempest-ServersNegativeTestJSON-573004776</nova:project>
Nov 24 10:36:33 user nova-compute[75073]:       </nova:owner>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:36:33 user nova-compute[75073]:       <nova:ports>
Nov 24 10:36:33 user nova-compute[75073]:         <nova:port uuid="81d58fe2-1825-4df2-a991-ed9e6632f371">
Nov 24 10:36:33 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:36:33 user nova-compute[75073]:         </nova:port>
Nov 24 10:36:33 user nova-compute[75073]:       </nova:ports>
Nov 24 10:36:33 user nova-compute[75073]:     </nova:instance>
Nov 24 10:36:33 user nova-compute[75073]:   </metadata>
Nov 24 10:36:33 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:36:33 user nova-compute[75073]:     <system>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="serial">b0927891-6586-4c71-9c78-d1b5ed8a2a01</entry>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="uuid">b0927891-6586-4c71-9c78-d1b5ed8a2a01</entry>
Nov 24 10:36:33 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:36:33 user nova-compute[75073]:     </system>
Nov 24 10:36:33 user nova-compute[75073]:   </sysinfo>
Nov 24 10:36:33 user nova-compute[75073]:   <os>
Nov 24 10:36:33 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:36:33 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:36:33 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:36:33 user nova-compute[75073]:   </os>
Nov 24 10:36:33 user nova-compute[75073]:   <features>
Nov 24 10:36:33 user nova-compute[75073]:     <acpi/>
Nov 24 10:36:33 user nova-compute[75073]:     <apic/>
Nov 24 10:36:33 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:36:33 user nova-compute[75073]:   </features>
Nov 24 10:36:33 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:36:33 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:36:33 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:36:33 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:36:33 user nova-compute[75073]:   </clock>
Nov 24 10:36:33 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:36:33 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:36:33 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:36:33 user nova-compute[75073]:   </cpu>
Nov 24 10:36:33 user nova-compute[75073]:   <devices>
Nov 24 10:36:33 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:36:33 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:36:33 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk"/>
Nov 24 10:36:33 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:36:33 user nova-compute[75073]:     </disk>
Nov 24 10:36:33 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:36:33 user nova-compute[75073]:       <mac address="fa:16:3e:27:56:d4"/>
Nov 24 10:36:33 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:36:33 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:36:33 user nova-compute[75073]:       <target dev="tap81d58fe2-18"/>
Nov 24 10:36:33 user nova-compute[75073]:     </interface>
Nov 24 10:36:33 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:36:33 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/console.log" append="off"/>
Nov 24 10:36:33 user nova-compute[75073]:     </serial>
Nov 24 10:36:33 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:36:33 user nova-compute[75073]:     <video>
Nov 24 10:36:33 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:36:33 user nova-compute[75073]:     </video>
Nov 24 10:36:33 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:36:33 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:36:33 user nova-compute[75073]:     </rng>
Nov 24 10:36:33 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:36:33 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:36:33 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:36:33 user nova-compute[75073]:     </memballoon>
Nov 24 10:36:33 user nova-compute[75073]:   </devices>
Nov 24 10:36:33 user nova-compute[75073]: </domain>
Nov 24 10:36:33 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1542362689',display_name='tempest-ServersNegativeTestJSON-server-1542362689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1542362689',id=27,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-kvhws04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:36:31Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=b0927891-6586-4c71-9c78-d1b5ed8a2a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG os_vif [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a58f7d4-62db-5f66-83ad-10f795bc0ea3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81d58fe2-18, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81d58fe2-18, col_values=(('qos', UUID('8f98fbb1-c41f-4799-82b2-a0e38e052a3c')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81d58fe2-18, col_values=(('external_ids', {'iface-id': '81d58fe2-1825-4df2-a991-ed9e6632f371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:56:d4', 'vm-uuid': 'b0927891-6586-4c71-9c78-d1b5ed8a2a01'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:33 user nova-compute[75073]: INFO os_vif [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18')
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] No VIF found with MAC fa:16:3e:27:56:d4, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.neutron [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updated VIF entry in instance network info cache for port 81d58fe2-1825-4df2-a991-ed9e6632f371. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG nova.network.neutron [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updating instance_info_cache with network_info: [{"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-531dc930-eb16-4988-82af-8cd02af042fa req-db6d46a4-b72c-4063-a612-511e0020211c service nova] Releasing lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:36:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] No waiting events found dispatching network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:36 user nova-compute[75073]: WARNING nova.compute.manager [req-007ee19c-eb0f-4a1b-871d-5ec0523ba5a2 req-928aca93-e5f3-40ca-bb29-34d6ab4b984a service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received unexpected event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 for instance with vm_state building and task_state spawning.
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:36:36 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Instance spawned successfully.
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:36 user nova-compute[75073]: INFO nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 24 10:36:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:36:36 user nova-compute[75073]: INFO nova.compute.manager [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Took 6.03 seconds to build instance.
Nov 24 10:36:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-581c5af2-561d-4f91-abbb-f85551799215 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.131s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:36:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Creating image(s)
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Ensure instance console log exists: /opt/stack/data/nova/instances/e126e888-7a3a-4485-8dca-10123710a543/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Start _get_guest_xml network_info=[{"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a57c4399-236d-44f2-88a7-4f4a14ae63a8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbMcsglt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e126e888-7a3a-4485-8dca-10123710a543', 'attached_at': '', 'detached_at': '', 'volume_id': '11faf3c2-f49c-40fd-b79c-7599c4c0029f', 'serial': '11faf3c2-f49c-40fd-b79c-7599c4c0029f'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:36:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbMcsglt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:36:38 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:36:38 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:36:38 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] No waiting events found dispatching network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:38 user nova-compute[75073]: WARNING nova.compute.manager [req-8ee774fe-cd1f-4644-b926-8350ab85b2b3 req-e47bb1c6-0b6e-4582-82d1-8d8e2a9d8833 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received unexpected event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 for instance with vm_state active and task_state None.
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f242df-5689-4715-bf17-4f3557939458]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:36:38 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e9b38-8d77-454a-a8f0-9deac3a4eb5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f] added
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[db30f335-5f4d-4292-8627-1027a0267ce0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266fe22-5804-440c-9974-4d8e95795e24]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbMcsglt {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbMcsglt" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72210d2-642d-4e91-875a-5d5340b4581e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbMcsglt'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecffa2f5-8bf5-4961-bda4-e919e7e6bca8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3051536-6b15-4007-a6b8-eac7d1e6f172]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7eb3f5-11de-4ddf-ba57-c71f6cbc7a12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260]
Nov 24 10:36:38 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260] successful.
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f497c91e-69e3-483a-bdab-a6e531a4ddc8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b4d7e-199c-4a5b-b2d4-11a9b2bedf09]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:36:38 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:36:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d406da-1c4b-4625-92ca-2646cae65a8e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:36:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbMcsglt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23630343231613631', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630343231613631', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720750920',display_name='tempest-TestVolumeBootPattern-server-720750920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720750920',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0yi9v9j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:36:26Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=e126e888-7a3a-4485-8dca-10123710a543,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.objects.instance [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid e126e888-7a3a-4485-8dca-10123710a543 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:36:39 user nova-compute[75073]:   <uuid>e126e888-7a3a-4485-8dca-10123710a543</uuid>
Nov 24 10:36:39 user nova-compute[75073]:   <name>instance-0000001a</name>
Nov 24 10:36:39 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:36:39 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:36:39 user nova-compute[75073]:   <metadata>
Nov 24 10:36:39 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:36:39 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:36:39 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-server-720750920</nova:name>
Nov 24 10:36:39 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:36:38</nova:creationTime>
Nov 24 10:36:39 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:36:39 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:36:39 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:36:39 user nova-compute[75073]:       <nova:owner>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:36:39 user nova-compute[75073]:       </nova:owner>
Nov 24 10:36:39 user nova-compute[75073]:       <nova:ports>
Nov 24 10:36:39 user nova-compute[75073]:         <nova:port uuid="9c0a2af2-e259-4a00-810b-75728fc55d3d">
Nov 24 10:36:39 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 10:36:39 user nova-compute[75073]:         </nova:port>
Nov 24 10:36:39 user nova-compute[75073]:       </nova:ports>
Nov 24 10:36:39 user nova-compute[75073]:     </nova:instance>
Nov 24 10:36:39 user nova-compute[75073]:   </metadata>
Nov 24 10:36:39 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:36:39 user nova-compute[75073]:     <system>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="serial">e126e888-7a3a-4485-8dca-10123710a543</entry>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="uuid">e126e888-7a3a-4485-8dca-10123710a543</entry>
Nov 24 10:36:39 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:36:39 user nova-compute[75073]:     </system>
Nov 24 10:36:39 user nova-compute[75073]:   </sysinfo>
Nov 24 10:36:39 user nova-compute[75073]:   <os>
Nov 24 10:36:39 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:36:39 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:36:39 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:36:39 user nova-compute[75073]:   </os>
Nov 24 10:36:39 user nova-compute[75073]:   <features>
Nov 24 10:36:39 user nova-compute[75073]:     <acpi/>
Nov 24 10:36:39 user nova-compute[75073]:     <apic/>
Nov 24 10:36:39 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:36:39 user nova-compute[75073]:   </features>
Nov 24 10:36:39 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:36:39 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:36:39 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:36:39 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:36:39 user nova-compute[75073]:   </clock>
Nov 24 10:36:39 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:36:39 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:36:39 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:36:39 user nova-compute[75073]:   </cpu>
Nov 24 10:36:39 user nova-compute[75073]:   <devices>
Nov 24 10:36:39 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:36:39 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:36:39 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:36:39 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:36:39 user nova-compute[75073]:       <serial>11faf3c2-f49c-40fd-b79c-7599c4c0029f</serial>
Nov 24 10:36:39 user nova-compute[75073]:     </disk>
Nov 24 10:36:39 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:36:39 user nova-compute[75073]:       <mac address="fa:16:3e:b2:ec:3e"/>
Nov 24 10:36:39 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:36:39 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:36:39 user nova-compute[75073]:       <target dev="tap9c0a2af2-e2"/>
Nov 24 10:36:39 user nova-compute[75073]:     </interface>
Nov 24 10:36:39 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:36:39 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/e126e888-7a3a-4485-8dca-10123710a543/console.log" append="off"/>
Nov 24 10:36:39 user nova-compute[75073]:     </serial>
Nov 24 10:36:39 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:36:39 user nova-compute[75073]:     <video>
Nov 24 10:36:39 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:36:39 user nova-compute[75073]:     </video>
Nov 24 10:36:39 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:36:39 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:36:39 user nova-compute[75073]:     </rng>
Nov 24 10:36:39 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:36:39 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:36:39 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:36:39 user nova-compute[75073]:     </memballoon>
Nov 24 10:36:39 user nova-compute[75073]:   </devices>
Nov 24 10:36:39 user nova-compute[75073]: </domain>
Nov 24 10:36:39 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720750920',display_name='tempest-TestVolumeBootPattern-server-720750920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720750920',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0yi9v9j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:36:26Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=e126e888-7a3a-4485-8dca-10123710a543,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG os_vif [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75f1bf3e-e53e-53bd-adb6-426ea3c3fbaf', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c0a2af2-e2, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c0a2af2-e2, col_values=(('qos', UUID('3174b17c-7605-4bdc-acd3-aac0f115a350')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c0a2af2-e2, col_values=(('external_ids', {'iface-id': '9c0a2af2-e259-4a00-810b-75728fc55d3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ec:3e', 'vm-uuid': 'e126e888-7a3a-4485-8dca-10123710a543'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:39 user nova-compute[75073]: INFO os_vif [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2')
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:36:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:b2:ec:3e, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] No waiting events found dispatching network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:41 user nova-compute[75073]: WARNING nova.compute.manager [req-203120c1-5217-4edd-b9ac-3ae13f59ae0a req-740fde60-c1ec-4425-85f4-5320c28f4191 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received unexpected event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d for instance with vm_state building and task_state spawning.
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] No waiting events found dispatching network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:43 user nova-compute[75073]: WARNING nova.compute.manager [req-70538acb-a84c-4232-be50-ed4907023660 req-4d1459cc-bfcb-4446-bb77-b7f4eb5f9d46 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received unexpected event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d for instance with vm_state building and task_state spawning.
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:36:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] Instance spawned successfully.
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:36:43 user nova-compute[75073]: INFO nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 24 10:36:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:36:43 user nova-compute[75073]: INFO nova.compute.manager [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Took 18.15 seconds to build instance.
Nov 24 10:36:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-28d6fc56-d9cd-4c92-bcd9-2a326652387c tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.386s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:36:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:36:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:36:49 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:49 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:36:49 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=25.275989532470703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:49 user nova-compute[75073]: INFO nova.compute.manager [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Terminating instance
Nov 24 10:36:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-16d96b36-7689-48e6-b499-c256db966d0d req-070f77bf-2849-41d3-a81a-7ce3b520ec05 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-unplugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 368baad5-b756-4ae5-aa18-9d148632523d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ccb126e6-2e9f-400e-9351-8183056a5410 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance e126e888-7a3a-4485-8dca-10123710a543 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Instance destroyed successfully.
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid ccb126e6-2e9f-400e-9351-8183056a5410 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-702734092',display_name='tempest-ServerRescueNegativeTestJSON-server-702734092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-702734092',id=2,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-76dwo0cl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:22:43Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=ccb126e6-2e9f-400e-9351-8183056a5410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "f4541341-e046-4363-ae69-dc00b3ce4f03", "address": "fa:16:3e:1e:76:dc", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4541341-e0", "ovs_interfaceid": "f4541341-e046-4363-ae69-dc00b3ce4f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG os_vif [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4541341-e0, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be34f089-31a7-4069-9f8d-03a899a1c9eb) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:36:50 user nova-compute[75073]: INFO os_vif [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:76:dc,bridge_name='br-int',has_traffic_filtering=True,id=f4541341-e046-4363-ae69-dc00b3ce4f03,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4541341-e0')
Nov 24 10:36:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Deleting instance files /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410_del
Nov 24 10:36:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Deletion of /opt/stack/data/nova/instances/ccb126e6-2e9f-400e-9351-8183056a5410_del complete
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: INFO nova.compute.manager [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:51 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Took 0.45 seconds to deallocate network for instance.
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-e3d67439-15eb-44d7-8ccf-f00b9526e135 req-b0be65cd-494c-4369-9e5c-3466ea915a46 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-deleted-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:51 user nova-compute[75073]: INFO nova.compute.manager [req-e3d67439-15eb-44d7-8ccf-f00b9526e135 req-b0be65cd-494c-4369-9e5c-3466ea915a46 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Neutron deleted interface f4541341-e046-4363-ae69-dc00b3ce4f03; detaching it from the instance and deleting it from the info cache
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-e3d67439-15eb-44d7-8ccf-f00b9526e135 req-b0be65cd-494c-4369-9e5c-3466ea915a46 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-e3d67439-15eb-44d7-8ccf-f00b9526e135 req-b0be65cd-494c-4369-9e5c-3466ea915a46 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Detach interface failed, port_id=f4541341-e046-4363-ae69-dc00b3ce4f03, reason: Instance ccb126e6-2e9f-400e-9351-8183056a5410 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:51 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Deleted allocations for instance ccb126e6-2e9f-400e-9351-8183056a5410
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fa4a32ce-a071-4d43-9618-c5f2e43dca1f tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "ccb126e6-2e9f-400e-9351-8183056a5410" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:36:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:36:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] Acquiring lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:36:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:36:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] Lock "ccb126e6-2e9f-400e-9351-8183056a5410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:36:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] No waiting events found dispatching network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:36:52 user nova-compute[75073]: WARNING nova.compute.manager [req-5d20ab54-d8b5-448a-9500-2c6c4bd9c68c req-b2384a4f-8854-4b08-9602-5983777c4ae9 service nova] [instance: ccb126e6-2e9f-400e-9351-8183056a5410] Received unexpected event network-vif-plugged-f4541341-e046-4363-ae69-dc00b3ce4f03 for instance with vm_state deleted and task_state None.
Nov 24 10:36:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:36:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:36:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:37:14 user nova-compute[75073]: INFO nova.compute.claims [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Claim successful on node user
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:37:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:37:14 user nova-compute[75073]: DEBUG nova.policy [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c5754304104fec9f1af3afc52e6f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99debe1b1a2443eba2f955911465f648', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:37:14 user nova-compute[75073]: INFO nova.virt.block_device [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Booting with volume-backed-image 095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604 at /dev/vda
Nov 24 10:37:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Successfully created port: e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Successfully updated port: e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-changed-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Refreshing instance network info cache due to event network-changed-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] Acquiring lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating instance_info_cache with network_info: [{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance network_info: |[{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] Acquired lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Refreshing network info cache for port e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updated VIF entry in instance network info cache for port e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating instance_info_cache with network_info: [{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5d2be3ec-8589-4ab9-baf3-985bc40216bd req-dea6bf96-8001-4efa-9d52-129eaad069cc service nova] Releasing lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.utils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88af79f-d429-49d4-a101-2872668861ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e4af5-7e74-4efb-b969-1cb4afa96caa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090a690-3211-44f1-97c2-6f6bc313b5df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199701a-7c7c-42ef-8ced-5939ee4497b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:20 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:37:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65ce9c-a412-48f9-85c1-888d1c684138]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG os_brick.utils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:20 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating existing volume attachment record: 92ef8b53-1f36-4c5c-aa4a-4f4b3a5ddace {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-changed-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Refreshing instance network info cache due to event network-changed-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG nova.network.neutron [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Refreshing network info cache for port 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG nova.network.neutron [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updated VIF entry in instance network info cache for port 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG nova.network.neutron [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a1b098f8-808a-47bf-a5ea-0ae95a100e74 req-a8d3c21b-f45e-4021-8f8f-de42f8d1d41b service nova] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:26 user nova-compute[75073]: INFO nova.compute.manager [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Attaching volume 35ee70ed-7d27-4ca2-adbf-91c2cdc22878 to /dev/vdb
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.utils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e7f81f-0c6b-40e4-8887-abd9912dc06b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb94ba9-b2cf-44b2-9215-1e244fc22e40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc641d2d-650c-461d-8906-b973c16ff87c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b55ca64-e36a-4cd8-8ea5-d8b8283b2db8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:26 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:37:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f124df-2e54-428d-9daf-2a5c05c6f4f6]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG os_brick.utils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:26 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating existing volume attachment record: 797ba21d-2614-4973-bad9-222f195fd382 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:37:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Creating image(s)
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Ensure instance console log exists: /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start _get_guest_xml network_info=[{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '92ef8b53-1f36-4c5c-aa4a-4f4b3a5ddace', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb708d85-9c31-4401-a367-c94337fb3e89', 'attached_at': '', 'detached_at': '', 'volume_id': '57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'serial': '57d3bb69-f1c2-4283-9a4a-42e278ab0323'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:37:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:27 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1347c7c-4f36-4f05-8acf-dcc99de45c81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:37:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b723029-00fa-458e-9701-cfd9e4dbef74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323] added
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b146de6-646f-42e3-959b-78143de1a6c2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a41f997-9ab1-41a6-8fde-ad6ba4ebc4a0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsYMQZI {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsYMQZI" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e379ed1f-cc00-42f1-82cf-8a26f1495378]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJsYMQZI'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46160b-cefe-4ca1-90d7-2a8b3e428191]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c62991-32b7-4428-9285-a234b48fce68]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c05859-b400-44e6-bd94-c2724a5ab679]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260]
Nov 24 10:37:27 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260] successful.
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e684e8c-98fd-48d3-b393-cddaf45b6d08]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815daf2-8a21-44c0-b3fd-a610734ba801]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2de97c-7285-4294-881c-b445d40bb0a4]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23065343138666532', 'path': '/dev/sde'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065343138666532', 'path': '/dev/sde'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2001348674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2001348674',id=28,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-l59cry4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:15Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=bb708d85-9c31-4401-a367-c94337fb3e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.objects.instance [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:37:28 user nova-compute[75073]:   <uuid>bb708d85-9c31-4401-a367-c94337fb3e89</uuid>
Nov 24 10:37:28 user nova-compute[75073]:   <name>instance-0000001c</name>
Nov 24 10:37:28 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:37:28 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:37:28 user nova-compute[75073]:   <metadata>
Nov 24 10:37:28 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:37:28 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2001348674</nova:name>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:37:27</nova:creationTime>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:37:28 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:37:28 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:owner>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:37:28 user nova-compute[75073]:       </nova:owner>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:37:28 user nova-compute[75073]:       <nova:ports>
Nov 24 10:37:28 user nova-compute[75073]:         <nova:port uuid="e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a">
Nov 24 10:37:28 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:37:28 user nova-compute[75073]:         </nova:port>
Nov 24 10:37:28 user nova-compute[75073]:       </nova:ports>
Nov 24 10:37:28 user nova-compute[75073]:     </nova:instance>
Nov 24 10:37:28 user nova-compute[75073]:   </metadata>
Nov 24 10:37:28 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:37:28 user nova-compute[75073]:     <system>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="serial">bb708d85-9c31-4401-a367-c94337fb3e89</entry>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="uuid">bb708d85-9c31-4401-a367-c94337fb3e89</entry>
Nov 24 10:37:28 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:37:28 user nova-compute[75073]:     </system>
Nov 24 10:37:28 user nova-compute[75073]:   </sysinfo>
Nov 24 10:37:28 user nova-compute[75073]:   <os>
Nov 24 10:37:28 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:37:28 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:37:28 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:37:28 user nova-compute[75073]:   </os>
Nov 24 10:37:28 user nova-compute[75073]:   <features>
Nov 24 10:37:28 user nova-compute[75073]:     <acpi/>
Nov 24 10:37:28 user nova-compute[75073]:     <apic/>
Nov 24 10:37:28 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:37:28 user nova-compute[75073]:   </features>
Nov 24 10:37:28 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:37:28 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:37:28 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:37:28 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:37:28 user nova-compute[75073]:   </clock>
Nov 24 10:37:28 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:37:28 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:37:28 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:37:28 user nova-compute[75073]:   </cpu>
Nov 24 10:37:28 user nova-compute[75073]:   <devices>
Nov 24 10:37:28 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:37:28 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:37:28 user nova-compute[75073]:       <source dev="/dev/sde"/>
Nov 24 10:37:28 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:37:28 user nova-compute[75073]:       <serial>57d3bb69-f1c2-4283-9a4a-42e278ab0323</serial>
Nov 24 10:37:28 user nova-compute[75073]:     </disk>
Nov 24 10:37:28 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:37:28 user nova-compute[75073]:       <mac address="fa:16:3e:f2:3c:41"/>
Nov 24 10:37:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:37:28 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:37:28 user nova-compute[75073]:       <target dev="tape970f3a3-8c"/>
Nov 24 10:37:28 user nova-compute[75073]:     </interface>
Nov 24 10:37:28 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:37:28 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/console.log" append="off"/>
Nov 24 10:37:28 user nova-compute[75073]:     </serial>
Nov 24 10:37:28 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:37:28 user nova-compute[75073]:     <video>
Nov 24 10:37:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:37:28 user nova-compute[75073]:     </video>
Nov 24 10:37:28 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:37:28 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:37:28 user nova-compute[75073]:     </rng>
Nov 24 10:37:28 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:37:28 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:37:28 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:37:28 user nova-compute[75073]:     </memballoon>
Nov 24 10:37:28 user nova-compute[75073]:   </devices>
Nov 24 10:37:28 user nova-compute[75073]: </domain>
Nov 24 10:37:28 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2001348674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2001348674',id=28,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-l59cry4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:15Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=bb708d85-9c31-4401-a367-c94337fb3e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG os_vif [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c45b39b2-05ff-53d9-a694-3ebb3e938e3a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape970f3a3-8c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape970f3a3-8c, col_values=(('qos', UUID('c7029e76-d3aa-43b1-acf7-b9c7a0319958')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape970f3a3-8c, col_values=(('external_ids', {'iface-id': 'e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:3c:41', 'vm-uuid': 'bb708d85-9c31-4401-a367-c94337fb3e89'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:28 user nova-compute[75073]: INFO os_vif [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c')
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:37:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:f2:3c:41, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:30 user nova-compute[75073]: WARNING nova.compute.manager [req-d881644e-bd28-4e53-8141-2c2d9a050a3b req-7a6a0d64-b74d-416d-8e01-05a321085773 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state building and task_state spawning.
Nov 24 10:37:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:37:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance spawned successfully.
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:37:32 user nova-compute[75073]: INFO nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:37:32 user nova-compute[75073]: INFO nova.compute.manager [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Took 18.08 seconds to build instance.
Nov 24 10:37:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-91541587-0516-47db-9653-99f8603c94a8 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.177s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:32 user nova-compute[75073]: WARNING nova.compute.manager [req-8927ce22-53f8-4dd3-9878-4e7499e0199a req-4652465e-fc28-4262-bf40-d08eca235909 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state None.
Nov 24 10:37:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:33 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:33 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:33 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65058e-1938-4ab3-8eb2-802b1cd4205e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:37:33 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19dca17-0e6a-4321-adf9-6cab136a4f6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878] added
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1752fa-7b80-4462-be3b-be50718fb8ee]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8b5cee-8f40-4fd1-97e7-883160a7ae30]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKkuJrnm {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKkuJrnm" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7876770-e99f-46ae-a2bd-cf6baddde2bd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKkuJrnm'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f6bda6-1429-4738-944d-998cde918bb0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc1391-20d3-4da0-85b3-a4df074f655f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e585395-fb04-4619-aa96-3e4b5db558bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]
Nov 24 10:37:33 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a582cd28-8f5c-4807-9538-74a5a8e726b7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cab188e-b67c-44dd-86ac-4f8ee00f0fbc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a826ac18-35f5-4627-bf7e-2a35c9da28bb]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:37:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing instance network info cache due to event network-changed-270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Refreshing network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '26461383635313035', 'path': '/dev/sdf'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383635313035', 'path': '/dev/sdf'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:37:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:37:34 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:37:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:37:34 user nova-compute[75073]:   <serial>35ee70ed-7d27-4ca2-adbf-91c2cdc22878</serial>
Nov 24 10:37:34 user nova-compute[75073]: </disk>
Nov 24 10:37:34 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated VIF entry in instance network info cache for port 270f3e17-8211-4cd8-b238-50bcf82dc6f1. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No VIF found with MAC fa:16:3e:d0:fd:eb, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-changed-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Refreshing instance network info cache due to event network-changed-21d1ddb6-dd66-44bc-b348-cab61370306e. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Refreshing network info cache for port 21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbf023da-7df6-4c64-9eea-7790137de965 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.693s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updated VIF entry in instance network info cache for port 21d1ddb6-dd66-44bc-b348-cab61370306e. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-566dea86-9b41-4246-9d18-bfd561dd9f75 req-858b7baa-19fd-452d-af18-fa039da8dbd6 service nova] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Stashing vm_state: active {{(pid=75073) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:37:36 user nova-compute[75073]: INFO nova.compute.claims [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Claim successful on node user
Nov 24 10:37:36 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating resource usage from migration e84ae765-835b-4849-9d1f-706c4347fe0e
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75073) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.437s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:36 user nova-compute[75073]: INFO nova.compute.manager [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Migrating
Nov 24 10:37:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:36 user nova-compute[75073]: WARNING nova.compute.manager [req-c3690b52-f887-407b-b0ac-f54a25f97e63 req-724a6277-98ba-4731-98a4-5686998d6718 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state active and task_state powering-off.
Nov 24 10:37:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Starting migrate_disk_and_power_off {{(pid=75073) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance destroyed successfully.
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-82baa400-98f5-421f-957b-ada1dbc859bb tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.918s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:37 user nova-compute[75073]: WARNING nova.compute.manager [req-670de3f3-c491-44ae-ae8a-843d16555093 req-f329f5d1-7c36-4030-9e6b-93bfdd34fd83 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state active and task_state resize_migrating.
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance destroyed successfully.
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d1ddb6-dd, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f989dd4e-cd86-4c78-a96e-b1f30d8d109c) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:37 user nova-compute[75073]: INFO os_vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd')
Nov 24 10:37:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:37 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9060fd88-69b8-4865-998d-ebf3a0c0b477]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:37:37 user nova-compute[75073]: No targets found.
Nov 24 10:37:37 user nova-compute[75073]: iSNS:
Nov 24 10:37:37 user nova-compute[75073]: No targets found.
Nov 24 10:37:37 user nova-compute[75073]: STATIC:
Nov 24 10:37:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878
Nov 24 10:37:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:37:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:37:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069
Nov 24 10:37:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:37:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:37:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:37:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:37:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:37:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f
Nov 24 10:37:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:37:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:37:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:37:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:37:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:37:37 user nova-compute[75073]: FIRMWARE:
Nov 24 10:37:37 user nova-compute[75073]: No targets found.
Nov 24 10:37:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:37:37 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:37:37 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bfa8b-6ec3-42ee-91f0-7ea383927c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[07938aaf-1d80-47a0-9be3-6cd3f1067ad2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238215510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c91157e-a73e-4875-9eba-f753bd5f83c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e75edb7-ef3f-40b7-b26b-a76fac87eeb0]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f146c88-cac3-43c8-ae15-810e4a4b3c07]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d3d7e-b42e-4658-9e3c-54c3f22809dd]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422cacf-bfa3-4052-bf83-b5b4fc0f18f7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549e364-6c25-4647-b025-09e7353473f5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]
Nov 24 10:37:38 user nova-compute[75073]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.
Nov 24 10:37:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201f644-d9d0-4b53-b020-d7ae622aabc2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== disconnect_volume: return (332ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:38 user nova-compute[75073]: WARNING nova.compute.manager [req-0b218129-c53c-4c8c-a373-ac54a2805d3a req-7d56dc59-6ead-4182-a806-007f5bf14a85 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state stopped and task_state None.
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Port 21d1ddb6-dd66-44bc-b348-cab61370306e binding to destination host user is already ACTIVE {{(pid=75073) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:39 user nova-compute[75073]: WARNING nova.compute.manager [req-90f45a67-eb7a-4e4a-acc3-715e6dad0ca7 req-b0b7e462-6b22-45ca-a5c6-0efb1896aee6 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state active and task_state resize_migrated.
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 06ed6f5a-958b-4414-9dbd-69641b193367 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 5945a479-75dc-4018-a7cd-80c5ab25b67c {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 20f8c036-492d-4389-bffb-7b6e5c120f39 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 28791ddc-1317-4147-9f52-59177a5c1715 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid e126e888-7a3a-4485-8dca-10123710a543 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid b0927891-6586-4c71-9c78-d1b5ed8a2a01 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "368baad5-b756-4ae5-aa18-9d148632523d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "28791ddc-1317-4147-9f52-59177a5c1715" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: INFO nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] During sync_power_state the instance has a pending task (resize_migrated). Skip.
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "28791ddc-1317-4147-9f52-59177a5c1715" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "e126e888-7a3a-4485-8dca-10123710a543" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG os_brick.utils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3bf114-3301-4633-8aa6-f7e36f96b315]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "368baad5-b756-4ae5-aa18-9d148632523d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8776e857-44ac-4a26-a8f8-a62112484c92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "e126e888-7a3a-4485-8dca-10123710a543" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[473855a7-0694-446b-9e75-80d8ad1c3a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ae248-4ed5-47b6-bbc6-47086e3f8ab3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:37:40 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[30206e28-dd7d-4dc0-8e01-f5282b531ff6]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG os_brick.utils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:40 user nova-compute[75073]: INFO nova.compute.manager [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Terminating instance
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-98784544-80b6-4097-860f-752cfe4bd1a4 req-cdb42175-6ce6-4088-ab3a-2785c665935a service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-unplugged-86f2db00-09e3-4054-a321-99883e964598 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:37:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Instance destroyed successfully.
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lazy-loading 'resources' on Instance uuid 368baad5-b756-4ae5-aa18-9d148632523d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1200068686',display_name='tempest-ServerRescueNegativeTestJSON-server-1200068686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1200068686',id=1,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7d3f3f3d5494608acae0f64a9bf8e9a',ramdisk_id='',reservation_id='r-dap0tq8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-443087693',owner_user_name='tempest-ServerRescueNegativeTestJSON-443087693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:27:26Z,user_data=None,user_id='22b4e168f7a8473d8664e9225c867318',uuid=368baad5-b756-4ae5-aa18-9d148632523d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converting VIF {"id": "86f2db00-09e3-4054-a321-99883e964598", "address": "fa:16:3e:23:11:5a", "network": {"id": "e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-674439817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7d3f3f3d5494608acae0f64a9bf8e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86f2db00-09", "ovs_interfaceid": "86f2db00-09e3-4054-a321-99883e964598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG os_vif [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86f2db00-09, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=907f66d3-f998-4063-9f2c-68b024b69313) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:40 user nova-compute[75073]: INFO os_vif [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=86f2db00-09e3-4054-a321-99883e964598,network=Network(e2c6e936-3bfc-4f6c-8a1c-a9bbde0796a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86f2db00-09')
Nov 24 10:37:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Deleting instance files /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d_del
Nov 24 10:37:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Deletion of /opt/stack/data/nova/instances/368baad5-b756-4ae5-aa18-9d148632523d_del complete
Nov 24 10:37:40 user nova-compute[75073]: INFO nova.compute.manager [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 24 10:37:40 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:37:40 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:41 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Took 0.41 seconds to deallocate network for instance.
Nov 24 10:37:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-9a4fb512-abcc-451b-9eb0-41f6de80fd9e req-56c0fe57-7537-4a93-ab21-e34615fb614d service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-deleted-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:37:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:41 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Deleted allocations for instance 368baad5-b756-4ae5-aa18-9d148632523d
Nov 24 10:37:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1129902f-27e6-4dac-9730-3cf4f2464285 tempest-ServerRescueNegativeTestJSON-443087693 tempest-ServerRescueNegativeTestJSON-443087693-project-member] Lock "368baad5-b756-4ae5-aa18-9d148632523d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] Acquiring lock "368baad5-b756-4ae5-aa18-9d148632523d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] Lock "368baad5-b756-4ae5-aa18-9d148632523d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] No waiting events found dispatching network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:42 user nova-compute[75073]: WARNING nova.compute.manager [req-32e0fc17-f727-4624-b344-5c9647709b8a req-d8a5eb06-edc5-4ce3-9d94-36825fcab1d9 service nova] [instance: 368baad5-b756-4ae5-aa18-9d148632523d] Received unexpected event network-vif-plugged-86f2db00-09e3-4054-a321-99883e964598 for instance with vm_state deleted and task_state None.
Nov 24 10:37:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:45 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Starting finish_migration {{(pid=75073) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:37:46 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Creating image(s)
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Ensure instance console log exists: /opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start _get_guest_xml network_info=[{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'e0bda661-85b7-47d5-b237-cfa17279e15e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '28791ddc-1317-4147-9f52-59177a5c1715', 'attached_at': '2023-11-24T10:37:47.000000', 'detached_at': '', 'volume_id': '18e2867b-9aad-4550-b379-d1f7b5419069', 'serial': '18e2867b-9aad-4550-b379-d1f7b5419069'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:37:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:46 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:37:46 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:46 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:37:46 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b67170f-e15d-4712-866d-18ae3d8ce902]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:37:46 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d765a896-54f9-46c5-831a-d55320529e9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069] added
Nov 24 10:37:46 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7fd77-2202-4fc4-835e-af773ba7720c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb03cce-2b34-4222-89c9-3c828784f0f0]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CciUmuAH {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CciUmuAH" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31647c9-9a96-4ebe-97bc-5fc9a3dae7ec]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CciUmuAH'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:46 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e79fed-d3ca-4839-8465-11d37c5198e6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ebafe-f4dd-465c-b057-217c9d5998bc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[af202ddd-f285-40ab-ae52-faae7134bdb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]
Nov 24 10:37:47 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.
Nov 24 10:37:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf945f-1cc0-4678-a4e7-aff7e1182eab]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed8299-0fa5-4fd8-bef9-af13f15bc844]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:37:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9a3c0-a404-4cf6-ba33-f10893edb797]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:37:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:37:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=25.293712615966797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26563356362306636', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563356362306636', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:37:48 user nova-compute[75073]:   <uuid>28791ddc-1317-4147-9f52-59177a5c1715</uuid>
Nov 24 10:37:48 user nova-compute[75073]:   <name>instance-00000019</name>
Nov 24 10:37:48 user nova-compute[75073]:   <memory>2097152</memory>
Nov 24 10:37:48 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:37:48 user nova-compute[75073]:   <metadata>
Nov 24 10:37:48 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:37:48 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:37:48 user nova-compute[75073]:       <nova:name>tempest-ServerActionsTestOtherA-server-1558710929</nova:name>
Nov 24 10:37:48 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:37:46</nova:creationTime>
Nov 24 10:37:48 user nova-compute[75073]:       <nova:flavor name="m1.small">
Nov 24 10:37:48 user nova-compute[75073]:         <nova:memory>2048</nova:memory>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:disk>20</nova:disk>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:37:48 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:37:48 user nova-compute[75073]:       <nova:owner>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:user uuid="dffd5f6353e344aa96a97235372632fd">tempest-ServerActionsTestOtherA-371935856-project-member</nova:user>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:project uuid="4665d407280c4667beadb1678e105480">tempest-ServerActionsTestOtherA-371935856</nova:project>
Nov 24 10:37:48 user nova-compute[75073]:       </nova:owner>
Nov 24 10:37:48 user nova-compute[75073]:       <nova:ports>
Nov 24 10:37:48 user nova-compute[75073]:         <nova:port uuid="21d1ddb6-dd66-44bc-b348-cab61370306e">
Nov 24 10:37:48 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:37:48 user nova-compute[75073]:         </nova:port>
Nov 24 10:37:48 user nova-compute[75073]:       </nova:ports>
Nov 24 10:37:48 user nova-compute[75073]:     </nova:instance>
Nov 24 10:37:48 user nova-compute[75073]:   </metadata>
Nov 24 10:37:48 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:37:48 user nova-compute[75073]:     <system>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="serial">28791ddc-1317-4147-9f52-59177a5c1715</entry>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="uuid">28791ddc-1317-4147-9f52-59177a5c1715</entry>
Nov 24 10:37:48 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:37:48 user nova-compute[75073]:     </system>
Nov 24 10:37:48 user nova-compute[75073]:   </sysinfo>
Nov 24 10:37:48 user nova-compute[75073]:   <os>
Nov 24 10:37:48 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:37:48 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:37:48 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:37:48 user nova-compute[75073]:   </os>
Nov 24 10:37:48 user nova-compute[75073]:   <features>
Nov 24 10:37:48 user nova-compute[75073]:     <acpi/>
Nov 24 10:37:48 user nova-compute[75073]:     <apic/>
Nov 24 10:37:48 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:37:48 user nova-compute[75073]:   </features>
Nov 24 10:37:48 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:37:48 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:37:48 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:37:48 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:37:48 user nova-compute[75073]:   </clock>
Nov 24 10:37:48 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:37:48 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:37:48 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:37:48 user nova-compute[75073]:   </cpu>
Nov 24 10:37:48 user nova-compute[75073]:   <devices>
Nov 24 10:37:48 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:37:48 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:37:48 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:37:48 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:37:48 user nova-compute[75073]:       <serial>18e2867b-9aad-4550-b379-d1f7b5419069</serial>
Nov 24 10:37:48 user nova-compute[75073]:     </disk>
Nov 24 10:37:48 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:37:48 user nova-compute[75073]:       <mac address="fa:16:3e:3f:38:d1"/>
Nov 24 10:37:48 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:37:48 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:37:48 user nova-compute[75073]:       <target dev="tap21d1ddb6-dd"/>
Nov 24 10:37:48 user nova-compute[75073]:     </interface>
Nov 24 10:37:48 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:37:48 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715/console.log" append="off"/>
Nov 24 10:37:48 user nova-compute[75073]:     </serial>
Nov 24 10:37:48 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:37:48 user nova-compute[75073]:     <video>
Nov 24 10:37:48 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:37:48 user nova-compute[75073]:     </video>
Nov 24 10:37:48 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:37:48 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:37:48 user nova-compute[75073]:     </rng>
Nov 24 10:37:48 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:37:48 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:37:48 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:37:48 user nova-compute[75073]:     </memballoon>
Nov 24 10:37:48 user nova-compute[75073]:   </devices>
Nov 24 10:37:48 user nova-compute[75073]: </domain>
Nov 24 10:37:48 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2112786719-network", "vif_mac": "fa:16:3e:3f:38:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG os_vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34762230-b4d3-5828-99ca-468037e934ab', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21d1ddb6-dd, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21d1ddb6-dd, col_values=(('qos', UUID('cac9955b-78bd-4a98-a721-6644ee1bd836')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21d1ddb6-dd, col_values=(('external_ids', {'iface-id': '21d1ddb6-dd66-44bc-b348-cab61370306e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:38:d1', 'vm-uuid': '28791ddc-1317-4147-9f52-59177a5c1715'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Applying migration context for instance 28791ddc-1317-4147-9f52-59177a5c1715 as it has an incoming, in-progress migration e84ae765-835b-4849-9d1f-706c4347fe0e. Migration status is post-migrating {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 10:37:48 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating resource usage from migration e84ae765-835b-4849-9d1f-706c4347fe0e
Nov 24 10:37:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:48 user nova-compute[75073]: INFO os_vif [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd')
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance e126e888-7a3a-4485-8dca-10123710a543 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance bb708d85-9c31-4401-a367-c94337fb3e89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Migration e84ae765-835b-4849-9d1f-706c4347fe0e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] No VIF found with MAC fa:16:3e:3f:38:d1, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:37:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:49 user nova-compute[75073]: WARNING nova.compute.manager [req-071d5ef1-2335-4f24-961f-7557d0cd4f3e req-500a2c56-dcf8-469e-bc7a-50d740d13ca1 service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state active and task_state resize_finish.
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:37:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 06ed6f5a-958b-4414-9dbd-69641b193367 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [{"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-06ed6f5a-958b-4414-9dbd-69641b193367" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:37:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance running successfully.
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Failed to set time: agent not configured {{(pid=75073) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c6f10aff-dcfb-447f-8b0c-c9a25d06a4f2 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] finish_migration finished successfully. {{(pid=75073) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:37:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:37:51 user nova-compute[75073]: WARNING nova.compute.manager [req-4e42781d-ef3d-4204-b999-915f3376a28c req-886ade0c-afeb-453a-a130-9bd45474e7ff service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state resized and task_state None.
Nov 24 10:37:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:56 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:37:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:37:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:16 user nova-compute[75073]: INFO nova.compute.manager [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Terminating instance
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-unplugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] No waiting events found dispatching network-vif-unplugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c1e6efb-640b-41a1-b9c9-e101e3074a6f req-4ec6a2b0-14a9-4227-8963-eef1ea4d0fc7 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-unplugged-9c0a2af2-e259-4a00-810b-75728fc55d3d for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:38:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] Instance destroyed successfully.
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid e126e888-7a3a-4485-8dca-10123710a543 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-720750920',display_name='tempest-TestVolumeBootPattern-server-720750920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-720750920',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0yi9v9j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:36:44Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=e126e888-7a3a-4485-8dca-10123710a543,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "address": "fa:16:3e:b2:ec:3e", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0a2af2-e2", "ovs_interfaceid": "9c0a2af2-e259-4a00-810b-75728fc55d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_vif [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c0a2af2-e2, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3174b17c-7605-4bdc-acd3-aac0f115a350) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:16 user nova-compute[75073]: INFO os_vif [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ec:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c0a2af2-e259-4a00-810b-75728fc55d3d,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0a2af2-e2')
Nov 24 10:38:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbMcsglt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:38:16 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[091fcf0c-57a9-4f49-8b57-a566acb9006d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:38:16 user nova-compute[75073]: No targets found.
Nov 24 10:38:16 user nova-compute[75073]: iSNS:
Nov 24 10:38:16 user nova-compute[75073]: No targets found.
Nov 24 10:38:16 user nova-compute[75073]: STATIC:
Nov 24 10:38:16 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878
Nov 24 10:38:16 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:38:16 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:38:16 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069
Nov 24 10:38:16 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:38:16 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:38:16 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:38:16 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:38:16 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:38:16 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f
Nov 24 10:38:16 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:38:16 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:38:16 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:38:16 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:38:16 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:38:16 user nova-compute[75073]: FIRMWARE:
Nov 24 10:38:16 user nova-compute[75073]: No targets found.
Nov 24 10:38:16 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:38:16 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:38:16 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b1065-10e6-4458-8265-3c764b7ccc43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eb2346-0c4a-4832-9b31-f6fc00a42138]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:38:16 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382479a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:16 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7c547b-675c-4050-93bf-f9ac26783f23]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d100f1-1def-42ab-8488-24f2167d6881]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a20046c-9821-4030-bee7-784080d78c09]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd908c1-c416-4f9c-9ac6-17ee8e8cdbf0]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a0fa4-0c2c-42a8-bc6e-21b601e70d96]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb722dc-bcb2-48f3-9881-7ef18f8b6c7e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260]
Nov 24 10:38:17 user nova-compute[75073]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f, portal: 172.16.0.220,3260] successful.
Nov 24 10:38:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11faf3c2-f49c-40fd-b79c-7599c4c0029f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e038f1e-0461-466b-8b7e-10b909f54861]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (320ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:38:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Deleting instance files /opt/stack/data/nova/instances/e126e888-7a3a-4485-8dca-10123710a543_del
Nov 24 10:38:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Deletion of /opt/stack/data/nova/instances/e126e888-7a3a-4485-8dca-10123710a543_del complete
Nov 24 10:38:17 user nova-compute[75073]: INFO nova.compute.manager [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 24 10:38:17 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:17 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: e126e888-7a3a-4485-8dca-10123710a543] Took 0.43 seconds to deallocate network for instance.
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bc568ca-82c3-4755-bc9d-0b7670d021e5 req-2f32231f-7b00-4847-813b-913cabc7e76c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-deleted-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:17 user nova-compute[75073]: INFO nova.compute.manager [req-0bc568ca-82c3-4755-bc9d-0b7670d021e5 req-2f32231f-7b00-4847-813b-913cabc7e76c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Neutron deleted interface 9c0a2af2-e259-4a00-810b-75728fc55d3d; detaching it from the instance and deleting it from the info cache
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-0bc568ca-82c3-4755-bc9d-0b7670d021e5 req-2f32231f-7b00-4847-813b-913cabc7e76c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-0bc568ca-82c3-4755-bc9d-0b7670d021e5 req-2f32231f-7b00-4847-813b-913cabc7e76c service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Detach interface failed, port_id=9c0a2af2-e259-4a00-810b-75728fc55d3d, reason: Instance e126e888-7a3a-4485-8dca-10123710a543 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] Acquiring lock "e126e888-7a3a-4485-8dca-10123710a543-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] Lock "e126e888-7a3a-4485-8dca-10123710a543-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] No waiting events found dispatching network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:18 user nova-compute[75073]: WARNING nova.compute.manager [req-340553e5-f396-40e1-8e46-3b36bcd3b16a req-e7fa5dd3-ea28-4a18-b182-772d43f50966 service nova] [instance: e126e888-7a3a-4485-8dca-10123710a543] Received unexpected event network-vif-plugged-9c0a2af2-e259-4a00-810b-75728fc55d3d for instance with vm_state active and task_state deleting.
Nov 24 10:38:18 user nova-compute[75073]: INFO nova.compute.manager [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Took 0.82 seconds to detach 1 volumes for instance.
Nov 24 10:38:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: e126e888-7a3a-4485-8dca-10123710a543] Deleting volume: 11faf3c2-f49c-40fd-b79c-7599c4c0029f {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:38:18 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:38:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:19 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance e126e888-7a3a-4485-8dca-10123710a543
Nov 24 10:38:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c40bd917-3453-4436-ba04-0a8afe6f0287 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "e126e888-7a3a-4485-8dca-10123710a543" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.063s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:38:22 user nova-compute[75073]: INFO nova.compute.claims [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Claim successful on node user
Nov 24 10:38:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:38:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:38:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Creating image(s)
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "/opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "/opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:22 user nova-compute[75073]: DEBUG nova.policy [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7eb1e6d109f94de791496a9d1850d8b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3eddcf7e79342b596d1f93d456051fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk 1073741824" returned: 0 in 0.045s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:23 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Successfully created port: c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Successfully updated port: c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquired lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-changed-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Refreshing instance network info cache due to event network-changed-c3774578-8c5b-45f8-be77-d860ff0eeb60. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] Acquiring lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Updating instance_info_cache with network_info: [{"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Releasing lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Instance network_info: |[{"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] Acquired lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Refreshing network info cache for port c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Start _get_guest_xml network_info=[{"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:38:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-497908546',display_name='tempest-ServersNegativeTestJSON-server-497908546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-497908546',id=29,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-7wgac99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:38:23Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lazy-loading 'pci_devices' on Instance uuid d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:38:24 user nova-compute[75073]:   <uuid>d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8</uuid>
Nov 24 10:38:24 user nova-compute[75073]:   <name>instance-0000001d</name>
Nov 24 10:38:24 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:38:24 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:38:24 user nova-compute[75073]:   <metadata>
Nov 24 10:38:24 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:38:24 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:name>tempest-ServersNegativeTestJSON-server-497908546</nova:name>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:38:24</nova:creationTime>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:38:24 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:38:24 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:owner>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:user uuid="7eb1e6d109f94de791496a9d1850d8b6">tempest-ServersNegativeTestJSON-573004776-project-member</nova:user>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:project uuid="e3eddcf7e79342b596d1f93d456051fa">tempest-ServersNegativeTestJSON-573004776</nova:project>
Nov 24 10:38:24 user nova-compute[75073]:       </nova:owner>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:38:24 user nova-compute[75073]:       <nova:ports>
Nov 24 10:38:24 user nova-compute[75073]:         <nova:port uuid="c3774578-8c5b-45f8-be77-d860ff0eeb60">
Nov 24 10:38:24 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:38:24 user nova-compute[75073]:         </nova:port>
Nov 24 10:38:24 user nova-compute[75073]:       </nova:ports>
Nov 24 10:38:24 user nova-compute[75073]:     </nova:instance>
Nov 24 10:38:24 user nova-compute[75073]:   </metadata>
Nov 24 10:38:24 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:38:24 user nova-compute[75073]:     <system>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="serial">d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8</entry>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="uuid">d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8</entry>
Nov 24 10:38:24 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:38:24 user nova-compute[75073]:     </system>
Nov 24 10:38:24 user nova-compute[75073]:   </sysinfo>
Nov 24 10:38:24 user nova-compute[75073]:   <os>
Nov 24 10:38:24 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:38:24 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:38:24 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:38:24 user nova-compute[75073]:   </os>
Nov 24 10:38:24 user nova-compute[75073]:   <features>
Nov 24 10:38:24 user nova-compute[75073]:     <acpi/>
Nov 24 10:38:24 user nova-compute[75073]:     <apic/>
Nov 24 10:38:24 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:38:24 user nova-compute[75073]:   </features>
Nov 24 10:38:24 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:38:24 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:38:24 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:38:24 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:38:24 user nova-compute[75073]:   </clock>
Nov 24 10:38:24 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:38:24 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:38:24 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:38:24 user nova-compute[75073]:   </cpu>
Nov 24 10:38:24 user nova-compute[75073]:   <devices>
Nov 24 10:38:24 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:38:24 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:38:24 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk"/>
Nov 24 10:38:24 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:38:24 user nova-compute[75073]:     </disk>
Nov 24 10:38:24 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:38:24 user nova-compute[75073]:       <mac address="fa:16:3e:8f:c7:33"/>
Nov 24 10:38:24 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:38:24 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:38:24 user nova-compute[75073]:       <target dev="tapc3774578-8c"/>
Nov 24 10:38:24 user nova-compute[75073]:     </interface>
Nov 24 10:38:24 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:38:24 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/console.log" append="off"/>
Nov 24 10:38:24 user nova-compute[75073]:     </serial>
Nov 24 10:38:24 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:38:24 user nova-compute[75073]:     <video>
Nov 24 10:38:24 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:38:24 user nova-compute[75073]:     </video>
Nov 24 10:38:24 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:38:24 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:38:24 user nova-compute[75073]:     </rng>
Nov 24 10:38:24 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:38:24 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:38:24 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:38:24 user nova-compute[75073]:     </memballoon>
Nov 24 10:38:24 user nova-compute[75073]:   </devices>
Nov 24 10:38:24 user nova-compute[75073]: </domain>
Nov 24 10:38:24 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-497908546',display_name='tempest-ServersNegativeTestJSON-server-497908546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-497908546',id=29,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-7wgac99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:38:23Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG os_vif [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7eb9d745-6e15-5f3a-8ded-eebf50e533c1', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3774578-8c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3774578-8c, col_values=(('qos', UUID('c201f13f-5f2d-4dd7-a1de-e387e24004a1')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3774578-8c, col_values=(('external_ids', {'iface-id': 'c3774578-8c5b-45f8-be77-d860ff0eeb60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:c7:33', 'vm-uuid': 'd7f6089e-fb47-4ca8-b908-7a83ab9e6fd8'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:24 user nova-compute[75073]: INFO os_vif [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c')
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] No VIF found with MAC fa:16:3e:8f:c7:33, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Updated VIF entry in instance network info cache for port c3774578-8c5b-45f8-be77-d860ff0eeb60. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG nova.network.neutron [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Updating instance_info_cache with network_info: [{"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-075b220b-8de0-4294-b1c3-4dcd04ad42b4 req-2fa00239-b935-403d-887c-e2981fa7667e service nova] Releasing lock "refresh_cache-d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:38:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:26 user nova-compute[75073]: WARNING nova.compute.manager [req-f554e7a8-a65a-4bda-830c-5f42f8591390 req-d835ffb9-6c7d-4cb9-817f-a0b8d5a1ad43 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state building and task_state spawning.
Nov 24 10:38:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:38:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Instance spawned successfully.
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:28 user nova-compute[75073]: INFO nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 24 10:38:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:38:28 user nova-compute[75073]: INFO nova.compute.manager [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Took 6.11 seconds to build instance.
Nov 24 10:38:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:28 user nova-compute[75073]: WARNING nova.compute.manager [req-11f0575f-3e63-436b-923c-b99bd0e40b49 req-1910b0be-85ba-40e7-9a59-bd64cef71ff9 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state active and task_state None.
Nov 24 10:38:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b019310d-911a-4aff-82b2-cb38653b4bd3 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.213s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:38:42 user nova-compute[75073]: INFO nova.compute.claims [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Claim successful on node user
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:38:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:38:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Creating image(s)
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG nova.policy [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e546129896f04ea89b745a89af5d8519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ada50f2ea94c2286e5986bbf106f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk 1073741824" returned: 0 in 0.048s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Cannot resize image /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Ensure instance console log exists: /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Successfully created port: eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:38:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Successfully updated port: eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing instance network info cache due to event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance network_info: |[{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start _get_guest_xml network_info=[{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:38:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:45 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI/t9ro4qAVlxLnzrPyeTU4eE2EY9h48fXpKzwePcqe7KIwljE+oAt0edhmHcw7f14WZVftt+5y8T2lehATO8OIcIPIMukV5DfuipVWVLQPBJpBfxzA46YukyHcE2qY9Q==',key_name='tempest-keypair-291933903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.objects.instance [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:38:45 user nova-compute[75073]:   <uuid>5e71c06b-3545-4aaa-93f6-9279da1b838d</uuid>
Nov 24 10:38:45 user nova-compute[75073]:   <name>instance-0000001e</name>
Nov 24 10:38:45 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:38:45 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:38:45 user nova-compute[75073]:   <metadata>
Nov 24 10:38:45 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:38:45 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1404493724</nova:name>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:38:45</nova:creationTime>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:38:45 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:38:45 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:owner>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:user uuid="e546129896f04ea89b745a89af5d8519">tempest-AttachVolumeShelveTestJSON-435396144-project-member</nova:user>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:project uuid="51ada50f2ea94c2286e5986bbf106f53">tempest-AttachVolumeShelveTestJSON-435396144</nova:project>
Nov 24 10:38:45 user nova-compute[75073]:       </nova:owner>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:38:45 user nova-compute[75073]:       <nova:ports>
Nov 24 10:38:45 user nova-compute[75073]:         <nova:port uuid="eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643">
Nov 24 10:38:45 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:38:45 user nova-compute[75073]:         </nova:port>
Nov 24 10:38:45 user nova-compute[75073]:       </nova:ports>
Nov 24 10:38:45 user nova-compute[75073]:     </nova:instance>
Nov 24 10:38:45 user nova-compute[75073]:   </metadata>
Nov 24 10:38:45 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:38:45 user nova-compute[75073]:     <system>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="serial">5e71c06b-3545-4aaa-93f6-9279da1b838d</entry>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="uuid">5e71c06b-3545-4aaa-93f6-9279da1b838d</entry>
Nov 24 10:38:45 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:38:45 user nova-compute[75073]:     </system>
Nov 24 10:38:45 user nova-compute[75073]:   </sysinfo>
Nov 24 10:38:45 user nova-compute[75073]:   <os>
Nov 24 10:38:45 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:38:45 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:38:45 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:38:45 user nova-compute[75073]:   </os>
Nov 24 10:38:45 user nova-compute[75073]:   <features>
Nov 24 10:38:45 user nova-compute[75073]:     <acpi/>
Nov 24 10:38:45 user nova-compute[75073]:     <apic/>
Nov 24 10:38:45 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:38:45 user nova-compute[75073]:   </features>
Nov 24 10:38:45 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:38:45 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:38:45 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:38:45 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:38:45 user nova-compute[75073]:   </clock>
Nov 24 10:38:45 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:38:45 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:38:45 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:38:45 user nova-compute[75073]:   </cpu>
Nov 24 10:38:45 user nova-compute[75073]:   <devices>
Nov 24 10:38:45 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:38:45 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:38:45 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk"/>
Nov 24 10:38:45 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:38:45 user nova-compute[75073]:     </disk>
Nov 24 10:38:45 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:38:45 user nova-compute[75073]:       <mac address="fa:16:3e:eb:79:34"/>
Nov 24 10:38:45 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:38:45 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:38:45 user nova-compute[75073]:       <target dev="tapeaaf0de1-e8"/>
Nov 24 10:38:45 user nova-compute[75073]:     </interface>
Nov 24 10:38:45 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:38:45 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/console.log" append="off"/>
Nov 24 10:38:45 user nova-compute[75073]:     </serial>
Nov 24 10:38:45 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:38:45 user nova-compute[75073]:     <video>
Nov 24 10:38:45 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:38:45 user nova-compute[75073]:     </video>
Nov 24 10:38:45 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:38:45 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:38:45 user nova-compute[75073]:     </rng>
Nov 24 10:38:45 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:38:45 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:38:45 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:38:45 user nova-compute[75073]:     </memballoon>
Nov 24 10:38:45 user nova-compute[75073]:   </devices>
Nov 24 10:38:45 user nova-compute[75073]: </domain>
Nov 24 10:38:45 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI/t9ro4qAVlxLnzrPyeTU4eE2EY9h48fXpKzwePcqe7KIwljE+oAt0edhmHcw7f14WZVftt+5y8T2lehATO8OIcIPIMukV5DfuipVWVLQPBJpBfxzA46YukyHcE2qY9Q==',key_name='tempest-keypair-291933903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:38:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG os_vif [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2455d964-edf7-5fa2-96cf-4bc1d39f4fb4', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaaf0de1-e8, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaaf0de1-e8, col_values=(('qos', UUID('d2257e29-6803-40ee-9363-978e9814b2b6')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaaf0de1-e8, col_values=(('external_ids', {'iface-id': 'eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:79:34', 'vm-uuid': '5e71c06b-3545-4aaa-93f6-9279da1b838d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:45 user nova-compute[75073]: INFO os_vif [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8')
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No VIF found with MAC fa:16:3e:eb:79:34, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updated VIF entry in instance network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-02356d68-e48d-4a39-b708-632325c5616b req-0e60b34e-f775-4289-9fea-2970f3554445 service nova] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:38:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:47 user nova-compute[75073]: WARNING nova.compute.manager [req-5fc071b6-b89d-4e49-8ae3-c8fd53d041b7 req-9040e2ab-1caf-4af3-a959-89001e048354 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state building and task_state spawning.
Nov 24 10:38:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:38:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:38:49 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance spawned successfully.
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:38:49 user nova-compute[75073]: INFO nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:49 user nova-compute[75073]: INFO nova.compute.manager [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Took 6.25 seconds to build instance.
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-830e8c8b-40c3-4569-ab41-0b3323030953 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.363s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:38:49 user nova-compute[75073]: WARNING nova.compute.manager [req-0c5084de-0e95-4778-9e39-e610b7101574 req-e229be69-cb3c-4797-b31b-14fd59435349 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state active and task_state None.
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:38:50 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:50 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7897MB free_disk=25.263595581054688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Applying migration context for instance 28791ddc-1317-4147-9f52-59177a5c1715 as it has an incoming, in-progress migration e84ae765-835b-4849-9d1f-706c4347fe0e. Migration status is finished {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 10:38:50 user nova-compute[75073]: INFO nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating resource usage from migration e84ae765-835b-4849-9d1f-706c4347fe0e
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance bb708d85-9c31-4401-a367-c94337fb3e89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Migration e84ae765-835b-4849-9d1f-706c4347fe0e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:38:50 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:38:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:38:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:38:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:38:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:38:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:38:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:05 user nova-compute[75073]: INFO nova.compute.manager [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Rescuing
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating instance_info_cache with network_info: [{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:05 user nova-compute[75073]: WARNING nova.compute.manager [req-1de8b156-8351-41bc-8648-2b53a26feee8 req-63f7f3d7-6889-4643-930d-dca2cac993b5 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state rescuing.
Nov 24 10:39:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance destroyed successfully.
Nov 24 10:39:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Attempting a stable device rescue
Nov 24 10:39:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75073) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance directory exists: not creating {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 10:39:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Creating image(s)
Nov 24 10:39:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "8f7b58c8f751d47a8919e83664132ecb253a179c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "8f7b58c8f751d47a8919e83664132ecb253a179c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG nova.virt.images [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] c75274bf-2a2a-478d-934c-71d6f1ddb241 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.part /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:07 user nova-compute[75073]: WARNING nova.compute.manager [req-4ec8bb94-9d42-4d88-897c-d883350d338b req-b7f40264-8898-4f77-aad5-5a50ff7ff8b8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state rescuing.
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.part /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.converted" returned: 0 in 0.380s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "8f7b58c8f751d47a8919e83664132ecb253a179c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.147s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "8f7b58c8f751d47a8919e83664132ecb253a179c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "8f7b58c8f751d47a8919e83664132ecb253a179c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c,backing_fmt=raw /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c,backing_fmt=raw /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue" returned: 0 in 0.045s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "8f7b58c8f751d47a8919e83664132ecb253a179c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'migration_context' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<bb708d85-9c31-4401-a367-c94337fb3e89> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start _get_guest_xml network_info=[{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:f2:3c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c75274bf-2a2a-478d-934c-71d6f1ddb241', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '92ef8b53-1f36-4c5c-aa4a-4f4b3a5ddace', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bb708d85-9c31-4401-a367-c94337fb3e89', 'attached_at': '', 'detached_at': '', 'volume_id': '57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'serial': '57d3bb69-f1c2-4283-9a4a-42e278ab0323'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<bb708d85-9c31-4401-a367-c94337fb3e89> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'numa_topology' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<bb708d85-9c31-4401-a367-c94337fb3e89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:08 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:08 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<bb708d85-9c31-4401-a367-c94337fb3e89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:39:08 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:08 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:08 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7838ff-3a31-45ee-9512-956f92b773e6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pJsYMQZI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 10:39:08 user nova-compute[75073]: node.name = iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:39:08 user nova-compute[75073]: node.tpgt = -1
Nov 24 10:39:08 user nova-compute[75073]: node.startup = automatic
Nov 24 10:39:08 user nova-compute[75073]: node.leading_login = No
Nov 24 10:39:08 user nova-compute[75073]: iface.iscsi_ifacename = default
Nov 24 10:39:08 user nova-compute[75073]: iface.net_ifacename = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.ipaddress = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.prefix_len = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.hwaddress = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.transport_name = tcp
Nov 24 10:39:08 user nova-compute[75073]: iface.initiatorname = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.vlan_id = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.vlan_priority = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.vlan_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.iface_num = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.mtu = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.port = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.bootproto = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.subnet_mask = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.gateway = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_alt_client_id = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_dns = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_learn_iqn = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_vendor_id_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_vendor_id = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.dhcp_slp_da = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.fragmentation = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.gratuitous_arp = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.incoming_forwarding = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.tos_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.tos = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.ttl = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.delayed_ack = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.tcp_nagle = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.tcp_wsf_state = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.tcp_wsf = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.tcp_timer_scale = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.tcp_timestamp = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.redirect = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.def_task_mgmt_timeout = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.header_digest = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.data_digest = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.immediate_data = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.initial_r2t = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.data_seq_inorder = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.data_pdu_inorder = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.erl = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.max_receive_data_len = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.first_burst_len = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.max_outstanding_r2t = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.max_burst_len = 0
Nov 24 10:39:08 user nova-compute[75073]: iface.chap_auth = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.bidi_chap = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.strict_login_compliance = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.discovery_auth = <empty>
Nov 24 10:39:08 user nova-compute[75073]: iface.discovery_logout = <empty>
Nov 24 10:39:08 user nova-compute[75073]: node.discovery_address = <empty>
Nov 24 10:39:08 user nova-compute[75073]: node.discovery_port = 0
Nov 24 10:39:08 user nova-compute[75073]: node.discovery_type = static
Nov 24 10:39:08 user nova-compute[75073]: node.session.initial_cmdsn = 0
Nov 24 10:39:08 user nova-compute[75073]: node.session.initial_login_retry_max = 8
Nov 24 10:39:08 user nova-compute[75073]: node.session.xmit_thread_priority = -20
Nov 24 10:39:08 user nova-compute[75073]: node.session.cmds_max = 128
Nov 24 10:39:08 user nova-compute[75073]: node.session.queue_depth = 32
Nov 24 10:39:08 user nova-compute[75073]: node.session.nr_sessions = 1
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.authmethod = CHAP
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.username = pJsYMQZI
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.password = ***
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.username_in = <empty>
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.password_in = <empty>
Nov 24 10:39:08 user nova-compute[75073]: node.session.auth.chap_algs = MD5
Nov 24 10:39:08 user nova-compute[75073]: node.session.timeo.replacement_timeout = 120
Nov 24 10:39:08 user nova-compute[75073]: node.session.err_timeo.abort_timeout = 15
Nov 24 10:39:08 user nova-compute[75073]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 10:39:08 user nova-compute[75073]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 10:39:08 user nova-compute[75073]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.FastAbort = Yes
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.InitialR2T = No
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.ImmediateData = Yes
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.MaxConnections = 1
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 10:39:08 user nova-compute[75073]: node.session.iscsi.ERL = 0
Nov 24 10:39:08 user nova-compute[75073]: node.session.scan = manual
Nov 24 10:39:08 user nova-compute[75073]: node.session.reopen_max = 0
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].address = 172.16.0.220
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].port = 3260
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].startup = manual
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].tcp.window_size = 524288
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].tcp.type_of_service = 0
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].timeo.logout_timeout = 15
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].timeo.login_timeout = 15
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].timeo.auth_timeout = 45
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.DataDigest = None
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.IFMarker = No
Nov 24 10:39:08 user nova-compute[75073]: node.conn[0].iscsi.OFMarker = No
Nov 24 10:39:08 user nova-compute[75073]: # END RECORD
Nov 24 10:39:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[393a1b8a-cee1-4305-9d11-dcdd8ba3a146]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1fcd9-5aba-4d28-80b7-00bead5d18d1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsYMQZI {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsYMQZI" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b2740f-adb8-4d57-b9ae-4a88378db232]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJsYMQZI'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40547873-5203-4061-bd7e-77f8cbaebe3d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6592b474-468b-459a-bfb6-c29a877f9999]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] HCTL ('36', '0', '0', 0) found on session 37 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd999eed-c4d9-4445-a699-840c874f1c0e]: (4, ('0 0 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Searching for a device in session 37 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23065343138666532', 'path': '/dev/sde'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065343138666532', 'path': '/dev/sde'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2001348674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2001348674',id=28,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-l59cry4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:32Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=bb708d85-9c31-4401-a367-c94337fb3e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:f2:3c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "vif_mac": "fa:16:3e:f2:3c:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.instance [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'pci_devices' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.objects.base [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Object Instance<bb708d85-9c31-4401-a367-c94337fb3e89> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:39:08 user nova-compute[75073]:   <uuid>bb708d85-9c31-4401-a367-c94337fb3e89</uuid>
Nov 24 10:39:08 user nova-compute[75073]:   <name>instance-0000001c</name>
Nov 24 10:39:08 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:39:08 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:39:08 user nova-compute[75073]:   <metadata>
Nov 24 10:39:08 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:39:08 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2001348674</nova:name>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:39:08</nova:creationTime>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:39:08 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:39:08 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:owner>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:user uuid="b2c5754304104fec9f1af3afc52e6f98">tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member</nova:user>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:project uuid="99debe1b1a2443eba2f955911465f648">tempest-ServerBootFromVolumeStableRescueTest-822129086</nova:project>
Nov 24 10:39:08 user nova-compute[75073]:       </nova:owner>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:39:08 user nova-compute[75073]:       <nova:ports>
Nov 24 10:39:08 user nova-compute[75073]:         <nova:port uuid="e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a">
Nov 24 10:39:08 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:39:08 user nova-compute[75073]:         </nova:port>
Nov 24 10:39:08 user nova-compute[75073]:       </nova:ports>
Nov 24 10:39:08 user nova-compute[75073]:     </nova:instance>
Nov 24 10:39:08 user nova-compute[75073]:   </metadata>
Nov 24 10:39:08 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:39:08 user nova-compute[75073]:     <system>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="serial">bb708d85-9c31-4401-a367-c94337fb3e89</entry>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="uuid">bb708d85-9c31-4401-a367-c94337fb3e89</entry>
Nov 24 10:39:08 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:39:08 user nova-compute[75073]:     </system>
Nov 24 10:39:08 user nova-compute[75073]:   </sysinfo>
Nov 24 10:39:08 user nova-compute[75073]:   <os>
Nov 24 10:39:08 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:39:08 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:39:08 user nova-compute[75073]:   </os>
Nov 24 10:39:08 user nova-compute[75073]:   <features>
Nov 24 10:39:08 user nova-compute[75073]:     <acpi/>
Nov 24 10:39:08 user nova-compute[75073]:     <apic/>
Nov 24 10:39:08 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:39:08 user nova-compute[75073]:   </features>
Nov 24 10:39:08 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:39:08 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:39:08 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:39:08 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:39:08 user nova-compute[75073]:   </clock>
Nov 24 10:39:08 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:39:08 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:39:08 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:39:08 user nova-compute[75073]:   </cpu>
Nov 24 10:39:08 user nova-compute[75073]:   <devices>
Nov 24 10:39:08 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:39:08 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:39:08 user nova-compute[75073]:       <source dev="/dev/sde"/>
Nov 24 10:39:08 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:39:08 user nova-compute[75073]:       <serial>57d3bb69-f1c2-4283-9a4a-42e278ab0323</serial>
Nov 24 10:39:08 user nova-compute[75073]:     </disk>
Nov 24 10:39:08 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:39:08 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:39:08 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue"/>
Nov 24 10:39:08 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:39:08 user nova-compute[75073]:       <boot order="1"/>
Nov 24 10:39:08 user nova-compute[75073]:     </disk>
Nov 24 10:39:08 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:39:08 user nova-compute[75073]:       <mac address="fa:16:3e:f2:3c:41"/>
Nov 24 10:39:08 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:08 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:39:08 user nova-compute[75073]:       <target dev="tape970f3a3-8c"/>
Nov 24 10:39:08 user nova-compute[75073]:     </interface>
Nov 24 10:39:08 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:39:08 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/console.log" append="off"/>
Nov 24 10:39:08 user nova-compute[75073]:     </serial>
Nov 24 10:39:08 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:39:08 user nova-compute[75073]:     <video>
Nov 24 10:39:08 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:08 user nova-compute[75073]:     </video>
Nov 24 10:39:08 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:39:08 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:39:08 user nova-compute[75073]:     </rng>
Nov 24 10:39:08 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:39:08 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:39:08 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:39:08 user nova-compute[75073]:     </memballoon>
Nov 24 10:39:08 user nova-compute[75073]:   </devices>
Nov 24 10:39:08 user nova-compute[75073]: </domain>
Nov 24 10:39:08 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:39:08 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance destroyed successfully.
Nov 24 10:39:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:39:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:39:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] No VIF found with MAC fa:16:3e:f2:3c:41, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:10 user nova-compute[75073]: WARNING nova.compute.manager [req-3d989468-4183-4685-b877-e0d49463b1f5 req-6e889953-c72c-48e6-ae50-d337c93b7f74 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state rescuing.
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:12 user nova-compute[75073]: WARNING nova.compute.manager [req-fc642fe1-246a-473a-a779-f83e79ac2e3c req-3f9e17f1-04b7-4fdd-97c4-918a7af243a8 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state rescuing.
Nov 24 10:39:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-98ea08c6-958f-4d81-a860-669d22c66fce tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:39:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:39:20 user nova-compute[75073]: INFO nova.compute.claims [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Claim successful on node user
Nov 24 10:39:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:39:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:39:20 user nova-compute[75073]: INFO nova.virt.block_device [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Booting with volume 58570d37-6c60-4974-a711-ea53683c800c at /dev/vda
Nov 24 10:39:20 user nova-compute[75073]: DEBUG nova.policy [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG os_brick.utils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39c1dbf-fae0-4d14-a88f-55b9b5531f7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847b4e0-4aa6-4334-b568-c2d1459dd616]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b779aa91-3674-45e6-b236-a360061628da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62129208-353c-4241-8424-6c88ef306165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:39:21 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:39:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b54972-bef6-446f-a928-2400bd8eecff]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updating existing volume attachment record: 31e7b34b-efdb-4838-818e-75c151117e65 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:39:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Successfully created port: 3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Successfully updated port: 3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-changed-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Refreshing instance network info cache due to event network-changed-3ba066d6-1530-4fc2-87aa-9d6305d418d6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] Acquiring lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updating instance_info_cache with network_info: [{"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Instance network_info: |[{"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] Acquired lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Refreshing network info cache for port 3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updated VIF entry in instance network info cache for port 3ba066d6-1530-4fc2-87aa-9d6305d418d6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG nova.network.neutron [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updating instance_info_cache with network_info: [{"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-67b42ce2-d3e8-4a38-bcb6-7acdc85f02ca req-ed63dbff-3575-4990-aa66-6f13e049f1d7 service nova] Releasing lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Going to confirm migration 2 {{(pid=75073) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquired lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:39:25 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'info_cache' on Instance uuid 28791ddc-1317-4147-9f52-59177a5c1715 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [{"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Releasing lock "refresh_cache-28791ddc-1317-4147-9f52-59177a5c1715" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'migration_context' on Instance uuid 28791ddc-1317-4147-9f52-59177a5c1715 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG nova.objects.base [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Object Instance<28791ddc-1317-4147-9f52-59177a5c1715> lazy-loaded attributes: info_cache,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:39:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.488s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:26 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Deleted allocation for migration e84ae765-835b-4849-9d1f-706c4347fe0e
Nov 24 10:39:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7c1f7eb6-8b77-41af-9d88-184234c721ca tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.479s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'info_cache' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:39:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Creating image(s)
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Ensure instance console log exists: /opt/stack/data/nova/instances/d5593503-6dec-4752-a76d-13357ef07dce/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Start _get_guest_xml network_info=[{"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '31e7b34b-efdb-4838-818e-75c151117e65', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvyakeSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5593503-6dec-4752-a76d-13357ef07dce', 'attached_at': '', 'detached_at': '', 'volume_id': '58570d37-6c60-4974-a711-ea53683c800c', 'serial': '58570d37-6c60-4974-a711-ea53683c800c'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:39:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvyakeSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:39:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:27 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622f653-02fc-4d0e-b2ad-3251c479d515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:39:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance destroyed successfully.
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'resources' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2070e187-2c67-49a0-99be-15108cc90745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c] added
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b97624e-3d, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=100cfc35-44db-4266-8f2b-5df48ff33ae5) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e905b9-e6a6-44be-8cfd-6c3f6211e730]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: INFO os_vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:39:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93e420-f389-4e1a-8424-5ee608f55c71]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvyakeSp {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvyakeSp" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec87cdb5-f17e-4f01-b4f7-c26bdf1f4772]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvyakeSp'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e7b08-46ad-4508-b386-314690e44704]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[400db1b9-a4db-439a-a42d-699f8b7293b4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d8ee6-77ad-4d5c-bd9d-42332aef726e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260]
Nov 24 10:39:27 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260] successful.
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[746002d5-8fb5-47d9-ad63-29ad658e8f4e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c289d4-f371-4037-81df-313363aecaa6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:27 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d67dbd-76c5-40d0-b8c3-c5730e7ca729]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:39:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvyakeSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:39:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23038366339393534', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:39:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038366339393534', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.258s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f7bfa-1a10-4e27-a044-12253190637c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:39:29 user nova-compute[75073]: No targets found.
Nov 24 10:39:29 user nova-compute[75073]: iSNS:
Nov 24 10:39:29 user nova-compute[75073]: No targets found.
Nov 24 10:39:29 user nova-compute[75073]: STATIC:
Nov 24 10:39:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878
Nov 24 10:39:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:39:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:39:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069
Nov 24 10:39:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:39:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:39:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:39:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:39:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:39:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:39:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:39:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:39:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:39:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:39:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:39:29 user nova-compute[75073]: FIRMWARE:
Nov 24 10:39:29 user nova-compute[75073]: No targets found.
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:39:29 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:39:29 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1567393195',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMabJECf7eS5WGqR3MpwmcQRv1OG1L2R3fK2TXnblA8AivUaTUHwKuv2aqbghXUVKxGMwY/vKqHRGx/iiUokyIM8c2XzNc5cHbUn1kMTYEQ1r7t0zKrpnmcYowfpwSTFVQ==',key_name='tempest-keypair-1382468796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-r7f6fy7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=d5593503-6dec-4752-a76d-13357ef07dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid d5593503-6dec-4752-a76d-13357ef07dce {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:39:29 user nova-compute[75073]:   <uuid>d5593503-6dec-4752-a76d-13357ef07dce</uuid>
Nov 24 10:39:29 user nova-compute[75073]:   <name>instance-0000001f</name>
Nov 24 10:39:29 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:39:29 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:39:29 user nova-compute[75073]:   <metadata>
Nov 24 10:39:29 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:39:29 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:39:29 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1567393195</nova:name>
Nov 24 10:39:29 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:39:27</nova:creationTime>
Nov 24 10:39:29 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:39:29 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:39:29 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:39:29 user nova-compute[75073]:       <nova:owner>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:39:29 user nova-compute[75073]:       </nova:owner>
Nov 24 10:39:29 user nova-compute[75073]:       <nova:ports>
Nov 24 10:39:29 user nova-compute[75073]:         <nova:port uuid="3ba066d6-1530-4fc2-87aa-9d6305d418d6">
Nov 24 10:39:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:39:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:39:29 user nova-compute[75073]:       </nova:ports>
Nov 24 10:39:29 user nova-compute[75073]:     </nova:instance>
Nov 24 10:39:29 user nova-compute[75073]:   </metadata>
Nov 24 10:39:29 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:39:29 user nova-compute[75073]:     <system>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="serial">d5593503-6dec-4752-a76d-13357ef07dce</entry>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="uuid">d5593503-6dec-4752-a76d-13357ef07dce</entry>
Nov 24 10:39:29 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:39:29 user nova-compute[75073]:     </system>
Nov 24 10:39:29 user nova-compute[75073]:   </sysinfo>
Nov 24 10:39:29 user nova-compute[75073]:   <os>
Nov 24 10:39:29 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:39:29 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:39:29 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:39:29 user nova-compute[75073]:   </os>
Nov 24 10:39:29 user nova-compute[75073]:   <features>
Nov 24 10:39:29 user nova-compute[75073]:     <acpi/>
Nov 24 10:39:29 user nova-compute[75073]:     <apic/>
Nov 24 10:39:29 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:39:29 user nova-compute[75073]:   </features>
Nov 24 10:39:29 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:39:29 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:39:29 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:39:29 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:39:29 user nova-compute[75073]:   </clock>
Nov 24 10:39:29 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:39:29 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:39:29 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:39:29 user nova-compute[75073]:   </cpu>
Nov 24 10:39:29 user nova-compute[75073]:   <devices>
Nov 24 10:39:29 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:39:29 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:39:29 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:39:29 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:39:29 user nova-compute[75073]:       <serial>58570d37-6c60-4974-a711-ea53683c800c</serial>
Nov 24 10:39:29 user nova-compute[75073]:     </disk>
Nov 24 10:39:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:39:29 user nova-compute[75073]:       <mac address="fa:16:3e:f8:5c:bb"/>
Nov 24 10:39:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:39:29 user nova-compute[75073]:       <target dev="tap3ba066d6-15"/>
Nov 24 10:39:29 user nova-compute[75073]:     </interface>
Nov 24 10:39:29 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:39:29 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d5593503-6dec-4752-a76d-13357ef07dce/console.log" append="off"/>
Nov 24 10:39:29 user nova-compute[75073]:     </serial>
Nov 24 10:39:29 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:39:29 user nova-compute[75073]:     <video>
Nov 24 10:39:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:29 user nova-compute[75073]:     </video>
Nov 24 10:39:29 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:39:29 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:39:29 user nova-compute[75073]:     </rng>
Nov 24 10:39:29 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:39:29 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:39:29 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:39:29 user nova-compute[75073]:     </memballoon>
Nov 24 10:39:29 user nova-compute[75073]:   </devices>
Nov 24 10:39:29 user nova-compute[75073]: </domain>
Nov 24 10:39:29 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1567393195',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMabJECf7eS5WGqR3MpwmcQRv1OG1L2R3fK2TXnblA8AivUaTUHwKuv2aqbghXUVKxGMwY/vKqHRGx/iiUokyIM8c2XzNc5cHbUn1kMTYEQ1r7t0zKrpnmcYowfpwSTFVQ==',key_name='tempest-keypair-1382468796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-r7f6fy7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=d5593503-6dec-4752-a76d-13357ef07dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_vif [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8dd122-d32e-457d-8f7a-d3b85c2914f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdfa0737-c71b-5d92-8c30-4428340d0f53', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ba066d6-15, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ba066d6-15, col_values=(('qos', UUID('5f30d685-4ab9-4963-8eb6-49746dc2cfb5')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ba066d6-15, col_values=(('external_ids', {'iface-id': '3ba066d6-1530-4fc2-87aa-9d6305d418d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:5c:bb', 'vm-uuid': 'd5593503-6dec-4752-a76d-13357ef07dce'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:29 user nova-compute[75073]: INFO os_vif [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15')
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b35fdb3-8f02-425a-93c7-c8d529db3ff5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383e3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878'): ({'sdf'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Removing single pathed devices sdf {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd032d-ba90-417e-8559-9c49e8dce36c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:f8:5c:bb, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eac5dd-0506-41c5-9d4b-3d5514283f7e]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flushing IO for device /dev/sdf {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd57d92-a631-4610-9c9e-2eebfd4ab8b7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca5506-9232-441c-8bbb-049e0f377fbd]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8a464-a9ae-4ae4-86ce-473339aeb2de]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd8611b-6351-4d98-842e-9f43a730e2ef]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]
Nov 24 10:39:29 user nova-compute[75073]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c5cc9-c462-4198-a6a5-46f1704bd31f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== disconnect_volume: return (1561ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start _get_guest_xml network_info=[{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '797ba21d-2614-4973-bad9-222f195fd382', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd619711b-81f7-4a70-96a3-380c5f4b99be', 'attached_at': '', 'detached_at': '', 'volume_id': '35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'serial': '35ee70ed-7d27-4ca2-adbf-91c2cdc22878'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'numa_topology' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'vcpu_model' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:39:29 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:29 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:39:29 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70586bb-b0e2-4851-bbbf-c393f5d7e9f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:39:29 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dccbe9c-9d93-425d-9f02-fff17fbf4fb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878] added
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd3131-02e7-4556-8b5c-8b47467e617c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab53d90-aa1a-4dda-b011-4104750f836d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKkuJrnm {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKkuJrnm" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df9544-f298-4e53-87d5-7ea968f04809]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKkuJrnm'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ed5d2-44e9-4378-8981-fd3ec485a975]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[265379ed-248f-4da2-88a6-0aee23352610]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95a5cbe-321b-47cc-aef3-ddce6036d154]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]
Nov 24 10:39:29 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[131327f8-1afc-4e61-99a4-83bfcf44712f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee9bab-0e73-4215-92c1-1ed953969f51]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:39:29 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:39:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6096f8a-34b0-43fd-9884-8d756d4f1643]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:39:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:30 user nova-compute[75073]: WARNING nova.compute.manager [req-a6e2aac5-a3de-4519-87ad-4ef5c14ef26d req-63649305-accc-4f2e-9d23-2dbc77534b7b service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state building and task_state spawning.
Nov 24 10:39:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26461383635313035', 'path': '/dev/sdf'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461383635313035', 'path': '/dev/sdf'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'pci_devices' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:39:30 user nova-compute[75073]:   <uuid>d619711b-81f7-4a70-96a3-380c5f4b99be</uuid>
Nov 24 10:39:30 user nova-compute[75073]:   <name>instance-00000018</name>
Nov 24 10:39:30 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:39:30 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:39:30 user nova-compute[75073]:   <metadata>
Nov 24 10:39:30 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:39:30 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeTestJSON-server-2047909114</nova:name>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:39:29</nova:creationTime>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:39:30 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:39:30 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:owner>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:user uuid="288a86b67b4f449faffbbfe208a2effe">tempest-AttachVolumeTestJSON-729242413-project-member</nova:user>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:project uuid="800195c134fc45b892777e8d8e1cb13e">tempest-AttachVolumeTestJSON-729242413</nova:project>
Nov 24 10:39:30 user nova-compute[75073]:       </nova:owner>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:39:30 user nova-compute[75073]:       <nova:ports>
Nov 24 10:39:30 user nova-compute[75073]:         <nova:port uuid="5b97624e-3d6d-48d3-8a02-50e9d17bb5c0">
Nov 24 10:39:30 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:39:30 user nova-compute[75073]:         </nova:port>
Nov 24 10:39:30 user nova-compute[75073]:       </nova:ports>
Nov 24 10:39:30 user nova-compute[75073]:     </nova:instance>
Nov 24 10:39:30 user nova-compute[75073]:   </metadata>
Nov 24 10:39:30 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:39:30 user nova-compute[75073]:     <system>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="serial">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="uuid">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:39:30 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:39:30 user nova-compute[75073]:     </system>
Nov 24 10:39:30 user nova-compute[75073]:   </sysinfo>
Nov 24 10:39:30 user nova-compute[75073]:   <os>
Nov 24 10:39:30 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:39:30 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:39:30 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:39:30 user nova-compute[75073]:   </os>
Nov 24 10:39:30 user nova-compute[75073]:   <features>
Nov 24 10:39:30 user nova-compute[75073]:     <acpi/>
Nov 24 10:39:30 user nova-compute[75073]:     <apic/>
Nov 24 10:39:30 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:39:30 user nova-compute[75073]:   </features>
Nov 24 10:39:30 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:39:30 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:39:30 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:39:30 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:39:30 user nova-compute[75073]:   </clock>
Nov 24 10:39:30 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:39:30 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:39:30 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:39:30 user nova-compute[75073]:   </cpu>
Nov 24 10:39:30 user nova-compute[75073]:   <devices>
Nov 24 10:39:30 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:39:30 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:39:30 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk"/>
Nov 24 10:39:30 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:39:30 user nova-compute[75073]:     </disk>
Nov 24 10:39:30 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:39:30 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:39:30 user nova-compute[75073]:       <source dev="/dev/sdf"/>
Nov 24 10:39:30 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 10:39:30 user nova-compute[75073]:       <serial>35ee70ed-7d27-4ca2-adbf-91c2cdc22878</serial>
Nov 24 10:39:30 user nova-compute[75073]:     </disk>
Nov 24 10:39:30 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:39:30 user nova-compute[75073]:       <mac address="fa:16:3e:d0:fd:eb"/>
Nov 24 10:39:30 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:30 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:39:30 user nova-compute[75073]:       <target dev="tap5b97624e-3d"/>
Nov 24 10:39:30 user nova-compute[75073]:     </interface>
Nov 24 10:39:30 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:39:30 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/console.log" append="off"/>
Nov 24 10:39:30 user nova-compute[75073]:     </serial>
Nov 24 10:39:30 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:39:30 user nova-compute[75073]:     <video>
Nov 24 10:39:30 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:39:30 user nova-compute[75073]:     </video>
Nov 24 10:39:30 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:39:30 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:39:30 user nova-compute[75073]:     </rng>
Nov 24 10:39:30 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:39:30 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:39:30 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:39:30 user nova-compute[75073]:     </memballoon>
Nov 24 10:39:30 user nova-compute[75073]:   </devices>
Nov 24 10:39:30 user nova-compute[75073]: </domain>
Nov 24 10:39:30 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'trusted_certs' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Cannot resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'migration_context' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.objects.base [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG os_vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '747ebf20-7d60-5943-ae3e-a4059238f4d6', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b97624e-3d, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b97624e-3d, col_values=(('qos', UUID('4baead16-28d6-454a-b856-e5fba7dd66aa')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b97624e-3d, col_values=(('external_ids', {'iface-id': '5b97624e-3d6d-48d3-8a02-50e9d17bb5c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fd:eb', 'vm-uuid': 'd619711b-81f7-4a70-96a3-380c5f4b99be'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:39:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:31 user nova-compute[75073]: INFO os_vif [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:39:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:39:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Instance spawned successfully.
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:39:32 user nova-compute[75073]: INFO nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:32 user nova-compute[75073]: WARNING nova.compute.manager [req-87efd64b-96ff-4dd0-8135-764b90a609c0 req-7148d0e8-f9b9-49bf-8628-3ca7c7104c0e service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state building and task_state spawning.
Nov 24 10:39:32 user nova-compute[75073]: INFO nova.compute.manager [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Took 12.37 seconds to build instance.
Nov 24 10:39:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7ba91037-c919-4023-b256-b67db64e0e06 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.466s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:33 user nova-compute[75073]: WARNING nova.compute.manager [req-70a03647-5820-4fbc-ab87-fd1f46d44e7e req-30d49146-39d0-4a89-9efd-6028f4ff1bb2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state stopped and task_state powering-on.
Nov 24 10:39:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:39:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance rebooted successfully.
Nov 24 10:39:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c225c7dc-0d27-44cd-9e89-50e47da88217 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:39:35 user nova-compute[75073]: WARNING nova.compute.manager [req-bcb98ab1-17e8-45c4-93bb-54b6b1f3a39f req-284b3e49-86fa-494b-a744-1d0644394e99 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state active and task_state None.
Nov 24 10:39:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:39:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:39:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:39:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:39:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7528MB free_disk=25.134445190429688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance bb708d85-9c31-4401-a367-c94337fb3e89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d5593503-6dec-4752-a76d-13357ef07dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:39:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:39:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [{"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-838112bb-7408-44a0-82f7-8606ac3f0d86" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:39:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:39:59 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:12 user nova-compute[75073]: INFO nova.compute.manager [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Terminating instance
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-6a14c8d2-89bc-42ac-86e7-c4726464d7af req-0076b719-e46e-4046-a728-42fe45171b44 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Instance destroyed successfully.
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lazy-loading 'resources' on Instance uuid d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-497908546',display_name='tempest-ServersNegativeTestJSON-server-497908546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-497908546',id=29,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-7wgac99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:38:28Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "address": "fa:16:3e:8f:c7:33", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3774578-8c", "ovs_interfaceid": "c3774578-8c5b-45f8-be77-d860ff0eeb60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG os_vif [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3774578-8c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c201f13f-5f2d-4dd7-a1de-e387e24004a1) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: INFO os_vif [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c7:33,bridge_name='br-int',has_traffic_filtering=True,id=c3774578-8c5b-45f8-be77-d860ff0eeb60,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3774578-8c')
Nov 24 10:40:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Deleting instance files /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8_del
Nov 24 10:40:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Deletion of /opt/stack/data/nova/instances/d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8_del complete
Nov 24 10:40:12 user nova-compute[75073]: INFO nova.compute.manager [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 24 10:40:12 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:13 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Took 0.46 seconds to deallocate network for instance.
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-916bdd47-011c-49c8-83d2-9ba4adf926ae req-43c841f1-d5ad-4b46-b3ab-86c8efc3d355 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-deleted-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:13 user nova-compute[75073]: INFO nova.compute.manager [req-916bdd47-011c-49c8-83d2-9ba4adf926ae req-43c841f1-d5ad-4b46-b3ab-86c8efc3d355 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Neutron deleted interface c3774578-8c5b-45f8-be77-d860ff0eeb60; detaching it from the instance and deleting it from the info cache
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.network.neutron [req-916bdd47-011c-49c8-83d2-9ba4adf926ae req-43c841f1-d5ad-4b46-b3ab-86c8efc3d355 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-916bdd47-011c-49c8-83d2-9ba4adf926ae req-43c841f1-d5ad-4b46-b3ab-86c8efc3d355 service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Detach interface failed, port_id=c3774578-8c5b-45f8-be77-d860ff0eeb60, reason: Instance d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:40:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:13 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Deleted allocations for instance d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8
Nov 24 10:40:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-661c57f6-729d-41ab-8902-9947af128f18 tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:14 user nova-compute[75073]: WARNING nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state deleted and task_state None.
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:14 user nova-compute[75073]: WARNING nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state deleted and task_state None.
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:14 user nova-compute[75073]: WARNING nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state deleted and task_state None.
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:14 user nova-compute[75073]: WARNING nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-unplugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state deleted and task_state None.
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Acquiring lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] Lock "d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] No waiting events found dispatching network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:14 user nova-compute[75073]: WARNING nova.compute.manager [req-51f5da6f-4fc0-476c-8a44-e969532d5b47 req-638feb60-ba24-4495-b303-8685b8f1640d service nova] [instance: d7f6089e-fb47-4ca8-b908-7a83ab9e6fd8] Received unexpected event network-vif-plugged-c3774578-8c5b-45f8-be77-d860ff0eeb60 for instance with vm_state deleted and task_state None.
Nov 24 10:40:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing instance network info cache due to event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updated VIF entry in instance network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f098734f-f851-42e1-8949-3693fa93d2c1 req-f5d4405b-86f4-477d-98cd-54fdcadeeeb4 service nova] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:40:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:38 user nova-compute[75073]: INFO nova.compute.manager [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Shelving
Nov 24 10:40:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:38 user nova-compute[75073]: WARNING nova.compute.manager [req-58c882cb-79bf-4a92-9501-aa739cc70155 req-0d8453fb-4467-4236-9fc3-add7930f7eb5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state active and task_state shelving.
Nov 24 10:40:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance destroyed successfully.
Nov 24 10:40:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Beginning cold snapshot process
Nov 24 10:40:38 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:40:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk /opt/stack/data/nova/instances/snapshots/tmpmxz0sy3u/7da1f3a795564064a986854f945d1faf {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk /opt/stack/data/nova/instances/snapshots/tmpmxz0sy3u/7da1f3a795564064a986854f945d1faf" returned: 0 in 0.887s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:39 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Snapshot extracted, beginning image upload
Nov 24 10:40:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:40 user nova-compute[75073]: WARNING nova.compute.manager [req-47eff86c-65ea-4527-a45d-48a6074f7b75 req-78d613bf-be14-49bb-b5fd-2f8fdd164aca service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state active and task_state shelving_image_uploading.
Nov 24 10:40:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Snapshot image upload complete
Nov 24 10:40:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:40:42 user nova-compute[75073]: INFO nova.compute.manager [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Shelve offloading
Nov 24 10:40:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance destroyed successfully.
Nov 24 10:40:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG nova.network.neutron [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG nova.network.neutron [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:40:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance destroyed successfully.
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.objects.instance [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'resources' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI/t9ro4qAVlxLnzrPyeTU4eE2EY9h48fXpKzwePcqe7KIwljE+oAt0edhmHcw7f14WZVftt+5y8T2lehATO8OIcIPIMukV5DfuipVWVLQPBJpBfxzA46YukyHcE2qY9Q==',key_name='tempest-keypair-291933903',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:40:42.182937',shelved_host='user',shelved_image_id='50507e65-6309-43a3-be73-1fc713b66348'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG os_vif [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaaf0de1-e8, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing instance network info cache due to event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2257e29-6803-40ee-9363-978e9814b2b6) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:43 user nova-compute[75073]: INFO os_vif [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8')
Nov 24 10:40:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Deleting instance files /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d_del
Nov 24 10:40:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Deletion of /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d_del complete
Nov 24 10:40:43 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Deleted allocations for instance 5e71c06b-3545-4aaa-93f6-9279da1b838d
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.objects.instance [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.objects.base [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<5e71c06b-3545-4aaa-93f6-9279da1b838d> lazy-loaded attributes: resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updated VIF entry in instance network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a15beb18-d365-4f7a-9d15-5b5d1a07a19d req-34bc1f6a-6c14-46ad-bc73-6feaf70f63b9 service nova] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-80886505-4b05-4352-8352-3393162a3353 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.578s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:44 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:44 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:40:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:40:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:40:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=25.13180923461914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance bb708d85-9c31-4401-a367-c94337fb3e89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d5593503-6dec-4752-a76d-13357ef07dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:40:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:40:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:40:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:40:54 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:40:55 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updating instance_info_cache with network_info: [{"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-20f8c036-492d-4389-bffb-7b6e5c120f39" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:40:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:40:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:40:56 user nova-compute[75073]: INFO nova.compute.manager [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Unrescuing
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquired lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating instance_info_cache with network_info: [{"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Releasing lock "refresh_cache-bb708d85-9c31-4401-a367-c94337fb3e89" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'flavor' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:56 user nova-compute[75073]: WARNING nova.compute.manager [req-b7025aa0-59b4-4c6b-893c-de5b08c985c3 req-ecb89a4e-23a7-4968-9aa9-3e15eba7c3aa service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:40:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:57 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance destroyed successfully.
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:58 user nova-compute[75073]: WARNING nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:58 user nova-compute[75073]: WARNING nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:40:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:40:58 user nova-compute[75073]: WARNING nova.compute.manager [req-cc970b91-a0fc-42e0-beb2-a9d50cdf70b7 req-ac4001e3-2b3d-4763-aa65-65b1828fd735 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state rescued and task_state unrescuing.
Nov 24 10:41:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-e9a0fffb-b7f1-466c-b0df-eff57474eda7 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:41:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-changed-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Refreshing instance network info cache due to event network-changed-3ba066d6-1530-4fc2-87aa-9d6305d418d6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:41:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] Acquiring lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:41:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] Acquired lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:41:11 user nova-compute[75073]: DEBUG nova.network.neutron [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Refreshing network info cache for port 3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:41:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updated VIF entry in instance network info cache for port 3ba066d6-1530-4fc2-87aa-9d6305d418d6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:41:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updating instance_info_cache with network_info: [{"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:41:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-97e7e771-1616-472d-b724-2f183ade41e9 req-5179409f-fd67-4721-a28d-fb8683b6f0c8 service nova] Releasing lock "refresh_cache-d5593503-6dec-4752-a76d-13357ef07dce" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:41:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:16 user nova-compute[75073]: INFO nova.compute.manager [None req-0e1c6046-4c6c-479e-b925-b27982d7366d tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Get console output
Nov 24 10:41:16 user nova-compute[75073]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 24 10:41:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.compute.manager [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Detaching volume 35ee70ed-7d27-4ca2-adbf-91c2cdc22878
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.virt.block_device [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Attempting to driver detach volume 35ee70ed-7d27-4ca2-adbf-91c2cdc22878 from mountpoint /dev/vdb
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.compute.claims [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Claim successful on node user
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Attempting to detach device vdb from instance d619711b-81f7-4a70-96a3-380c5f4b99be from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:41:18 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:41:18 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:41:18 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:41:18 user nova-compute[75073]:   <serial>35ee70ed-7d27-4ca2-adbf-91c2cdc22878</serial>
Nov 24 10:41:18 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:41:18 user nova-compute[75073]: </disk>
Nov 24 10:41:18 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdb from instance d619711b-81f7-4a70-96a3-380c5f4b99be from the persistent domain config.
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d619711b-81f7-4a70-96a3-380c5f4b99be from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:41:18 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:41:18 user nova-compute[75073]:   <source dev="/dev/sdf"/>
Nov 24 10:41:18 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:41:18 user nova-compute[75073]:   <serial>35ee70ed-7d27-4ca2-adbf-91c2cdc22878</serial>
Nov 24 10:41:18 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:41:18 user nova-compute[75073]: </disk>
Nov 24 10:41:18 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:41:18 user nova-compute[75073]: INFO nova.virt.block_device [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Booting with volume snapshot 88541079-3106-4f1a-ac9f-0e2e97ec9d41 at /dev/vda
Nov 24 10:41:18 user nova-compute[75073]: DEBUG nova.policy [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:41:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Successfully created port: 93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Successfully updated port: 93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-changed-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Refreshing instance network info cache due to event network-changed-93b19d86-b11d-41e3-a7fc-4e57a2924935. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] Acquiring lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating instance_info_cache with network_info: [{"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Instance network_info: |[{"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] Acquired lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:41:20 user nova-compute[75073]: DEBUG nova.network.neutron [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Refreshing network info cache for port 93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:41:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updated VIF entry in instance network info cache for port 93b19d86-b11d-41e3-a7fc-4e57a2924935. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:41:21 user nova-compute[75073]: DEBUG nova.network.neutron [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating instance_info_cache with network_info: [{"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:41:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76c10234-9aa9-4923-b395-bce6a2c2e8d6 req-3651b185-e8ae-49c4-8279-5df67012704e service nova] Releasing lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:41:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.utils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[510f1db2-d4dd-4dac-88d3-296252b8d6f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756f2e5-73d0-406a-8a32-f46d5ff6f16a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[158570c6-a95b-47f9-acae-8006777c63b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d687edb-f158-496e-a531-e9f253e95add]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:41:24 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:41:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bf31a1-2e53-4e31-85f5-848f7fd1b6d7]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG os_brick.utils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:41:24 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating existing volume attachment record: abb1899f-86c3-4ebf-9ecc-bb86d4e608a6 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:41:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:41:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Creating image(s)
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Ensure instance console log exists: /opt/stack/data/nova/instances/64349c82-852d-4bae-a78d-30a8cc2f6835/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Start _get_guest_xml network_info=[{"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-24T10:41:13Z,direct_url=<?>,disk_format='qcow2',id=6f55b343-d616-41ba-890b-d2c9a4fcbc60,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-108931584',owner='f60805f65e934beb8c272dfb1f74b042',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-24T10:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'abb1899f-86c3-4ebf-9ecc-bb86d4e608a6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfEwpocU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64349c82-852d-4bae-a78d-30a8cc2f6835', 'attached_at': '', 'detached_at': '', 'volume_id': '4e1aac20-19fa-493e-89f2-b638fdd77100', 'serial': '4e1aac20-19fa-493e-89f2-b638fdd77100'}, 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:41:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:41:31 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-24T10:41:13Z,direct_url=<?>,disk_format='qcow2',id=6f55b343-d616-41ba-890b-d2c9a4fcbc60,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-108931584',owner='f60805f65e934beb8c272dfb1f74b042',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-24T10:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfEwpocU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:41:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:41:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:41:31 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cff9791-4743-4f1c-9a36-050329a1e669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:41:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b07fec7-1ae0-4549-82fa-f614e8fb8e9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100] added
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8d48b-3f77-4d12-a9fb-962bf84551f6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40225ab-d9d7-4792-be2b-307c2b29a530]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfEwpocU {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfEwpocU" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d00891-7854-4ab7-a6d9-329ffe17df9d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfEwpocU'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7196f6c5-2cff-4b52-9601-89ff78972501]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ffa571-3ac3-43c9-9d0c-6a1acddeebe3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3d121-a771-4a57-8a4d-702a98515c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260]
Nov 24 10:41:31 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260] successful.
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1072fc-66e5-4487-84ac-406fd19259e7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd76d01-83d5-4258-b8ae-de356d34b9c5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:41:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c06e1-9d4c-4d59-96c5-67ca29303de3]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:41:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfEwpocU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26161383262623135', 'path': '/dev/sdg'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161383262623135', 'path': '/dev/sdg'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-542421547',id=32,image_ref='6f55b343-d616-41ba-890b-d2c9a4fcbc60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5G6FLRrJuaR3zFxjWFlBg4wSc9tskzsKPWC56xtfs1ZvnkceQAKfNp7hAjzLijJxfkV/ufXFiw7ZOCX40xz5gkwIjMxHZptuUD0OwtpKtLPCbdSmt1ykpaue/WfaLEw==',key_name='tempest-keypair-731082022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0pnm88g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1949066801',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=64349c82-852d-4bae-a78d-30a8cc2f6835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid 64349c82-852d-4bae-a78d-30a8cc2f6835 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:41:32 user nova-compute[75073]:   <uuid>64349c82-852d-4bae-a78d-30a8cc2f6835</uuid>
Nov 24 10:41:32 user nova-compute[75073]:   <name>instance-00000020</name>
Nov 24 10:41:32 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:41:32 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:41:32 user nova-compute[75073]:   <metadata>
Nov 24 10:41:32 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:41:32 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-542421547</nova:name>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:41:31</nova:creationTime>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:41:32 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:41:32 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:owner>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:41:32 user nova-compute[75073]:       </nova:owner>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:root type="image" uuid="6f55b343-d616-41ba-890b-d2c9a4fcbc60"/>
Nov 24 10:41:32 user nova-compute[75073]:       <nova:ports>
Nov 24 10:41:32 user nova-compute[75073]:         <nova:port uuid="93b19d86-b11d-41e3-a7fc-4e57a2924935">
Nov 24 10:41:32 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:41:32 user nova-compute[75073]:         </nova:port>
Nov 24 10:41:32 user nova-compute[75073]:       </nova:ports>
Nov 24 10:41:32 user nova-compute[75073]:     </nova:instance>
Nov 24 10:41:32 user nova-compute[75073]:   </metadata>
Nov 24 10:41:32 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:41:32 user nova-compute[75073]:     <system>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="serial">64349c82-852d-4bae-a78d-30a8cc2f6835</entry>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="uuid">64349c82-852d-4bae-a78d-30a8cc2f6835</entry>
Nov 24 10:41:32 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:41:32 user nova-compute[75073]:     </system>
Nov 24 10:41:32 user nova-compute[75073]:   </sysinfo>
Nov 24 10:41:32 user nova-compute[75073]:   <os>
Nov 24 10:41:32 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:41:32 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:41:32 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:41:32 user nova-compute[75073]:   </os>
Nov 24 10:41:32 user nova-compute[75073]:   <features>
Nov 24 10:41:32 user nova-compute[75073]:     <acpi/>
Nov 24 10:41:32 user nova-compute[75073]:     <apic/>
Nov 24 10:41:32 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:41:32 user nova-compute[75073]:   </features>
Nov 24 10:41:32 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:41:32 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:41:32 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:41:32 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:41:32 user nova-compute[75073]:   </clock>
Nov 24 10:41:32 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:41:32 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:41:32 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:41:32 user nova-compute[75073]:   </cpu>
Nov 24 10:41:32 user nova-compute[75073]:   <devices>
Nov 24 10:41:32 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:41:32 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:41:32 user nova-compute[75073]:       <source dev="/dev/sdg"/>
Nov 24 10:41:32 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:41:32 user nova-compute[75073]:       <serial>4e1aac20-19fa-493e-89f2-b638fdd77100</serial>
Nov 24 10:41:32 user nova-compute[75073]:     </disk>
Nov 24 10:41:32 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:41:32 user nova-compute[75073]:       <mac address="fa:16:3e:1a:fb:aa"/>
Nov 24 10:41:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:41:32 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:41:32 user nova-compute[75073]:       <target dev="tap93b19d86-b1"/>
Nov 24 10:41:32 user nova-compute[75073]:     </interface>
Nov 24 10:41:32 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:41:32 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/64349c82-852d-4bae-a78d-30a8cc2f6835/console.log" append="off"/>
Nov 24 10:41:32 user nova-compute[75073]:     </serial>
Nov 24 10:41:32 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:41:32 user nova-compute[75073]:     <video>
Nov 24 10:41:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:41:32 user nova-compute[75073]:     </video>
Nov 24 10:41:32 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:41:32 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:41:32 user nova-compute[75073]:     </rng>
Nov 24 10:41:32 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:41:32 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:41:32 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:41:32 user nova-compute[75073]:     </memballoon>
Nov 24 10:41:32 user nova-compute[75073]:   </devices>
Nov 24 10:41:32 user nova-compute[75073]: </domain>
Nov 24 10:41:32 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-542421547',id=32,image_ref='6f55b343-d616-41ba-890b-d2c9a4fcbc60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5G6FLRrJuaR3zFxjWFlBg4wSc9tskzsKPWC56xtfs1ZvnkceQAKfNp7hAjzLijJxfkV/ufXFiw7ZOCX40xz5gkwIjMxHZptuUD0OwtpKtLPCbdSmt1ykpaue/WfaLEw==',key_name='tempest-keypair-731082022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0pnm88g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1949066801',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=64349c82-852d-4bae-a78d-30a8cc2f6835,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG os_vif [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b58871c7-b2ef-5dd9-a32e-26675519c390', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93b19d86-b1, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93b19d86-b1, col_values=(('qos', UUID('a78c9eaf-80ab-4829-8c85-225ea5be6b36')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93b19d86-b1, col_values=(('external_ids', {'iface-id': '93b19d86-b11d-41e3-a7fc-4e57a2924935', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:fb:aa', 'vm-uuid': '64349c82-852d-4bae-a78d-30a8cc2f6835'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:32 user nova-compute[75073]: INFO os_vif [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1')
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:41:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:1a:fb:aa, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] No waiting events found dispatching network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:41:34 user nova-compute[75073]: WARNING nova.compute.manager [req-ec5d62c3-359f-4400-af71-a90c2dc57576 req-47227736-c8ec-43a2-bd28-23691addef33 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received unexpected event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 for instance with vm_state building and task_state spawning.
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:41:36 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Instance spawned successfully.
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:41:36 user nova-compute[75073]: INFO nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] No waiting events found dispatching network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:41:36 user nova-compute[75073]: WARNING nova.compute.manager [req-f55c92e6-14b1-498c-b8f5-8210d47ca5e9 req-051eaba1-5ab5-403e-b031-0e6504e0ad3f service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received unexpected event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 for instance with vm_state building and task_state spawning.
Nov 24 10:41:36 user nova-compute[75073]: INFO nova.compute.manager [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Took 18.05 seconds to build instance.
Nov 24 10:41:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-affa9d49-323e-416b-a7af-378aa8474052 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.152s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:38 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d619711b-81f7-4a70-96a3-380c5f4b99be is timed out.
Nov 24 10:41:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdb from instance d619711b-81f7-4a70-96a3-380c5f4b99be from the live domain config.
Nov 24 10:41:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKkuJrnm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:41:38 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43fee9e-6c2d-4ac6-bcca-4c5508fe1fe1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:41:38 user nova-compute[75073]: No targets found.
Nov 24 10:41:38 user nova-compute[75073]: iSNS:
Nov 24 10:41:38 user nova-compute[75073]: No targets found.
Nov 24 10:41:38 user nova-compute[75073]: STATIC:
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:41:38 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:41:38 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:41:38 user nova-compute[75073]: FIRMWARE:
Nov 24 10:41:38 user nova-compute[75073]: No targets found.
Nov 24 10:41:38 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:41:38 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:41:38 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a90ea-6848-4d6d-a46c-a3c217aae4b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c5637b-ca7a-4964-a604-0c64419ade0a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:41:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238200af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878'): ({'sdf'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Removing single pathed devices sdf {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca289417-165e-4e96-b66f-10696bc10994]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d319f-acbb-4ee8-8981-c3e4302d7943]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flushing IO for device /dev/sdf {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e16954-d6a6-46a6-bdfa-6b37d8fd6ad3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f54fb4a-e9ee-4ebe-ab60-5ce12ef3c557]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] SCSI volumes sdf have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15b737-3871-4ece-aa94-88e3723e28ab]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64329a-0b39-4eb0-9dfa-67a7071b97d2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260]
Nov 24 10:41:39 user nova-compute[75073]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878, portal: 172.16.0.220,3260] successful.
Nov 24 10:41:39 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ee70ed-7d27-4ca2-adbf-91c2cdc22878 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269427d-21b8-4673-bc87-f57e2cde8010]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== disconnect_volume: return (345ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:41:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da880050-5f5b-4323-a260-e326dbb37331 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.882s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75073) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 24 10:41:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:41:41 user nova-compute[75073]: WARNING nova.compute.manager [req-e1d0f5e3-076f-44f9-9ab6-6e035cb730dd req-22079a13-28a2-4260-892f-313323c4a182 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state active and task_state powering-off.
Nov 24 10:41:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance destroyed successfully.
Nov 24 10:41:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:41:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b7ebb1b7-74cf-4f57-b375-9c18a324b9df tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.853s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:41:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:41:43 user nova-compute[75073]: WARNING nova.compute.manager [req-84fbf548-374c-4b84-ad11-d5dad6d71304 req-ca53d5a5-2e8b-47e4-8ea3-33d81776aa0e service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state stopped and task_state None.
Nov 24 10:41:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:41:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:41:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:41:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:41:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:41:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=7873MB free_disk=25.130146026611328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance bb708d85-9c31-4401-a367-c94337fb3e89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 28791ddc-1317-4147-9f52-59177a5c1715 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d5593503-6dec-4752-a76d-13357ef07dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 64349c82-852d-4bae-a78d-30a8cc2f6835 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:41:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:41:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:41:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:41:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:41:55 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:41:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:41:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:41:56 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:41:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:41:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:41:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:41:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:17 user nova-compute[75073]: INFO nova.compute.manager [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Terminating instance
Nov 24 10:42:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-52e09785-81d2-4c46-a2c0-1e9c90ee339b req-701b9d7e-cfe3-4720-8563-6d75bfc1ee9c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-unplugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:42:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Instance destroyed successfully.
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'resources' on Instance uuid 28791ddc-1317-4147-9f52-59177a5c1715 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1558710929',display_name='tempest-ServerActionsTestOtherA-server-1558710929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1558710929',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-p6xs7hfy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=28791ddc-1317-4147-9f52-59177a5c1715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "21d1ddb6-dd66-44bc-b348-cab61370306e", "address": "fa:16:3e:3f:38:d1", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21d1ddb6-dd", "ovs_interfaceid": "21d1ddb6-dd66-44bc-b348-cab61370306e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_vif [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21d1ddb6-dd, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac9955b-78bd-4a98-a721-6644ee1bd836) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:18 user nova-compute[75073]: INFO os_vif [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:38:d1,bridge_name='br-int',has_traffic_filtering=True,id=21d1ddb6-dd66-44bc-b348-cab61370306e,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21d1ddb6-dd')
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CciUmuAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:42:18 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84cbeb-224e-40b3-b2c8-f8cff9ebd565]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:42:18 user nova-compute[75073]: No targets found.
Nov 24 10:42:18 user nova-compute[75073]: iSNS:
Nov 24 10:42:18 user nova-compute[75073]: No targets found.
Nov 24 10:42:18 user nova-compute[75073]: STATIC:
Nov 24 10:42:18 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100
Nov 24 10:42:18 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:18 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:18 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069
Nov 24 10:42:18 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:18 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:18 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:42:18 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:18 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:18 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:42:18 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:18 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:18 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:42:18 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:18 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:18 user nova-compute[75073]: FIRMWARE:
Nov 24 10:42:18 user nova-compute[75073]: No targets found.
Nov 24 10:42:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:42:18 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:42:18 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a8d7a-da6e-4d84-8d4e-d8e26c4da206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ad6545-842e-48fe-959e-dea8ce23aa55]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:18 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382cd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa13ebe-8379-4000-8c6b-18f928c0a3f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[900caf1d-cc3f-41a5-a975-b918876b62dc]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db9012-2a58-48b6-ab18-ad24a40f685a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbab09d-066b-4d4f-9d88-1bec3192c479]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b694cbd', '/dev/disk/by-id/scsi-26563356362306636', '/dev/disk/by-id/scsi-1SCST_BIOb694cbd-ec5cb0f69a32a262') {{(pid=85267) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a41790-74a2-482d-b278-bc9f224a90d0]: (4, None) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fee6f5-4762-4633-975d-a5bc183618f7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc42edb-1b4d-46df-815c-19f38f3be218]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260]
Nov 24 10:42:18 user nova-compute[75073]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069, portal: 172.16.0.220,3260] successful.
Nov 24 10:42:18 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e2867b-9aad-4550-b379-d1f7b5419069 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d6ec44-d13f-419c-8bce-0bde4e117ded]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] <== disconnect_volume: return (322ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:42:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Deleting instance files /opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715_del
Nov 24 10:42:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Deletion of /opt/stack/data/nova/instances/28791ddc-1317-4147-9f52-59177a5c1715_del complete
Nov 24 10:42:18 user nova-compute[75073]: INFO nova.compute.manager [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 24 10:42:18 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:42:18 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:42:19 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:42:19 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Took 0.67 seconds to deallocate network for instance.
Nov 24 10:42:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] Acquiring lock "28791ddc-1317-4147-9f52-59177a5c1715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] Lock "28791ddc-1317-4147-9f52-59177a5c1715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] No waiting events found dispatching network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:19 user nova-compute[75073]: WARNING nova.compute.manager [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received unexpected event network-vif-plugged-21d1ddb6-dd66-44bc-b348-cab61370306e for instance with vm_state active and task_state deleting.
Nov 24 10:42:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-a7c67a21-9b9e-4ec3-b4cb-74653fc37e7e req-19b5c789-59bc-448a-bb06-f588b9aea31c service nova] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Received event network-vif-deleted-21d1ddb6-dd66-44bc-b348-cab61370306e {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:19 user nova-compute[75073]: INFO nova.compute.manager [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Took 0.74 seconds to detach 1 volumes for instance.
Nov 24 10:42:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 28791ddc-1317-4147-9f52-59177a5c1715] Deleting volume: 18e2867b-9aad-4550-b379-d1f7b5419069 {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:42:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:20 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:42:20 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:42:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:20 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Deleted allocations for instance 28791ddc-1317-4147-9f52-59177a5c1715
Nov 24 10:42:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9409c9cf-bf5b-471f-ba48-53245a7bb498 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "28791ddc-1317-4147-9f52-59177a5c1715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:30 user nova-compute[75073]: INFO nova.compute.manager [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Unshelving
Nov 24 10:42:30 user nova-compute[75073]: INFO nova.virt.block_device [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Booting with volume 66286b42-d84f-41d7-8b19-b8b97e9f2bf4 at /dev/vdc
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.utils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7466bcf-60b4-4624-95cb-d82a023d5cc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910b4fa-fe9b-4f93-a1a6-75aabb0d1a54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b8be9f-d0a5-4600-95ed-bcd3c392e5d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f67c3-e971-43b9-a1b0-ec7c8feb4191]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:42:30 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:42:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb881c6-f874-4ae6-a7c0-879ea3af04f9]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG os_brick.utils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:42:30 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating existing volume attachment record: 65e76cdc-cf36-4544-b0c3-c73861cda9ce {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:42:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_requests' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:42:36 user nova-compute[75073]: INFO nova.compute.claims [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Claim successful on node user
Nov 24 10:42:37 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:37 user nova-compute[75073]: INFO nova.network.neutron [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing instance network info cache due to event network-changed-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:42:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] Acquiring lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:42:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Creating image(s)
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] Acquired lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG nova.network.neutron [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Refreshing network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG nova.objects.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<5e71c06b-3545-4aaa-93f6-9279da1b838d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG nova.virt.images [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] 50507e65-6309-43a3-be73-1fc713b66348 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.part /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updated VIF entry in instance network info cache for port eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1def8fa-7d3d-452c-b52d-274bff070c8c req-81744b78-865e-428d-9363-c58f4a75e63b service nova] Releasing lock "refresh_cache-5e71c06b-3545-4aaa-93f6-9279da1b838d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.part /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.converted" returned: 0 in 0.211s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.661s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54,backing_fmt=raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54,backing_fmt=raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk 1073741824" returned: 0 in 0.048s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "4970810ccdb93c94b94f34f4c36e5f82411a5b54" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'migration_context' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG nova.objects.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<5e71c06b-3545-4aaa-93f6-9279da1b838d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:42:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Rebasing disk image.
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b -F raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b -F raw /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk" returned: 0 in 2.353s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Ensure instance console log exists: /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start _get_guest_xml network_info=[{"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1dae67452b2d111a6e72f3eed9d634a6',container_format='bare',created_at=2023-11-24T10:40:38Z,direct_url=<?>,disk_format='qcow2',id=50507e65-6309-43a3-be73-1fc713b66348,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1404493724-shelved',owner='51ada50f2ea94c2286e5986bbf106f53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T10:40:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '65e76cdc-cf36-4544-b0c3-c73861cda9ce', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWfcyIEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5e71c06b-3545-4aaa-93f6-9279da1b838d', 'attached_at': '', 'detached_at': '', 'volume_id': '66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 'serial': '66286b42-d84f-41d7-8b19-b8b97e9f2bf4'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:42:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:42:42 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1dae67452b2d111a6e72f3eed9d634a6',container_format='bare',created_at=2023-11-24T10:40:38Z,direct_url=<?>,disk_format='qcow2',id=50507e65-6309-43a3-be73-1fc713b66348,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1404493724-shelved',owner='51ada50f2ea94c2286e5986bbf106f53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T10:40:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:42 user nova-compute[75073]: DEBUG nova.objects.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<5e71c06b-3545-4aaa-93f6-9279da1b838d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWfcyIEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:42:43 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:42:43 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:42:43 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f67af4-41ab-4a39-b3ba-038771dc798f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:42:43 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb79cb-a692-49e8-a638-7723ecc7ffd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4] added
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[957e376f-40f8-4c49-a7fe-e5ad6b07c23e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ac7584-1f1c-4828-b9dd-8037ce2317da]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWfcyIEj {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWfcyIEj" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cdbaa1-29ca-41c8-962f-fec365a588e3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gWfcyIEj'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f931d7d-dd7c-4e89-9972-01e4bfd33b4e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee306d7-0c1e-442b-9d05-257194e485bb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2471b0-83fb-45c8-b305-559b31d3ba27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260]
Nov 24 10:42:43 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260] successful.
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58e2f95-b0a8-4b99-afb7-e3ca8abff772]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[414666b0-d857-4eb9-b984-019fb6c2fd66]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:42:43 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[920037c5-9fa5-4571-ba85-a4dea1ef7588]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:43 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWfcyIEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23638333639333934', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638333639333934', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='50507e65-6309-43a3-be73-1fc713b66348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-291933903',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:40:42.182937',shelved_host='user',shelved_image_id='50507e65-6309-43a3-be73-1fc713b66348'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.objects.base [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<5e71c06b-3545-4aaa-93f6-9279da1b838d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:42:44 user nova-compute[75073]:   <uuid>5e71c06b-3545-4aaa-93f6-9279da1b838d</uuid>
Nov 24 10:42:44 user nova-compute[75073]:   <name>instance-0000001e</name>
Nov 24 10:42:44 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:42:44 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:42:44 user nova-compute[75073]:   <metadata>
Nov 24 10:42:44 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:42:44 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1404493724</nova:name>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:42:42</nova:creationTime>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:42:44 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:42:44 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:owner>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:user uuid="e546129896f04ea89b745a89af5d8519">tempest-AttachVolumeShelveTestJSON-435396144-project-member</nova:user>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:project uuid="51ada50f2ea94c2286e5986bbf106f53">tempest-AttachVolumeShelveTestJSON-435396144</nova:project>
Nov 24 10:42:44 user nova-compute[75073]:       </nova:owner>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:root type="image" uuid="50507e65-6309-43a3-be73-1fc713b66348"/>
Nov 24 10:42:44 user nova-compute[75073]:       <nova:ports>
Nov 24 10:42:44 user nova-compute[75073]:         <nova:port uuid="eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643">
Nov 24 10:42:44 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:42:44 user nova-compute[75073]:         </nova:port>
Nov 24 10:42:44 user nova-compute[75073]:       </nova:ports>
Nov 24 10:42:44 user nova-compute[75073]:     </nova:instance>
Nov 24 10:42:44 user nova-compute[75073]:   </metadata>
Nov 24 10:42:44 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:42:44 user nova-compute[75073]:     <system>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="serial">5e71c06b-3545-4aaa-93f6-9279da1b838d</entry>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="uuid">5e71c06b-3545-4aaa-93f6-9279da1b838d</entry>
Nov 24 10:42:44 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:42:44 user nova-compute[75073]:     </system>
Nov 24 10:42:44 user nova-compute[75073]:   </sysinfo>
Nov 24 10:42:44 user nova-compute[75073]:   <os>
Nov 24 10:42:44 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:42:44 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:42:44 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:42:44 user nova-compute[75073]:   </os>
Nov 24 10:42:44 user nova-compute[75073]:   <features>
Nov 24 10:42:44 user nova-compute[75073]:     <acpi/>
Nov 24 10:42:44 user nova-compute[75073]:     <apic/>
Nov 24 10:42:44 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:42:44 user nova-compute[75073]:   </features>
Nov 24 10:42:44 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:42:44 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:42:44 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:42:44 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:42:44 user nova-compute[75073]:   </clock>
Nov 24 10:42:44 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:42:44 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:42:44 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:42:44 user nova-compute[75073]:   </cpu>
Nov 24 10:42:44 user nova-compute[75073]:   <devices>
Nov 24 10:42:44 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:42:44 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:42:44 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk"/>
Nov 24 10:42:44 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:42:44 user nova-compute[75073]:     </disk>
Nov 24 10:42:44 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:42:44 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:42:44 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:42:44 user nova-compute[75073]:       <target dev="vdc" bus="virtio"/>
Nov 24 10:42:44 user nova-compute[75073]:       <serial>66286b42-d84f-41d7-8b19-b8b97e9f2bf4</serial>
Nov 24 10:42:44 user nova-compute[75073]:     </disk>
Nov 24 10:42:44 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:42:44 user nova-compute[75073]:       <mac address="fa:16:3e:eb:79:34"/>
Nov 24 10:42:44 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:42:44 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:42:44 user nova-compute[75073]:       <target dev="tapeaaf0de1-e8"/>
Nov 24 10:42:44 user nova-compute[75073]:     </interface>
Nov 24 10:42:44 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:42:44 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/console.log" append="off"/>
Nov 24 10:42:44 user nova-compute[75073]:     </serial>
Nov 24 10:42:44 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:42:44 user nova-compute[75073]:     <video>
Nov 24 10:42:44 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:42:44 user nova-compute[75073]:     </video>
Nov 24 10:42:44 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:42:44 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:42:44 user nova-compute[75073]:     </rng>
Nov 24 10:42:44 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:42:44 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:42:44 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:42:44 user nova-compute[75073]:     </memballoon>
Nov 24 10:42:44 user nova-compute[75073]:   </devices>
Nov 24 10:42:44 user nova-compute[75073]: </domain>
Nov 24 10:42:44 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='50507e65-6309-43a3-be73-1fc713b66348',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-291933903',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:38:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:40:42.182937',shelved_host='user',shelved_image_id='50507e65-6309-43a3-be73-1fc713b66348'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG os_vif [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2455d964-edf7-5fa2-96cf-4bc1d39f4fb4', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaaf0de1-e8, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaaf0de1-e8, col_values=(('qos', UUID('46cf5bec-6a97-4606-8a0d-b89922889e33')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaaf0de1-e8, col_values=(('external_ids', {'iface-id': 'eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:79:34', 'vm-uuid': '5e71c06b-3545-4aaa-93f6-9279da1b838d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:44 user nova-compute[75073]: INFO os_vif [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8')
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:42:44 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No VIF found with MAC fa:16:3e:eb:79:34, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG nova.compute.manager [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:46 user nova-compute[75073]: WARNING nova.compute.manager [req-2155fb0c-a7ce-4591-bf6f-b1a0bdf26a07 req-d0bd543d-1942-41fe-9c94-907c56b9f0f5 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:46 user nova-compute[75073]: INFO nova.compute.manager [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Terminating instance
Nov 24 10:42:46 user nova-compute[75073]: DEBUG nova.compute.manager [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.compute.manager [req-a126d19b-08fb-4052-80e5-8159e4d08178 req-fa11c635-2053-4152-bb8e-b6643b9efb83 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-unplugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Instance destroyed successfully.
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.objects.instance [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid bb708d85-9c31-4401-a367-c94337fb3e89 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2001348674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2001348674',id=28,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-l59cry4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:41:01Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=bb708d85-9c31-4401-a367-c94337fb3e89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "address": "fa:16:3e:f2:3c:41", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape970f3a3-8c", "ovs_interfaceid": "e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_vif [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape970f3a3-8c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7029e76-d3aa-43b1-acf7-b9c7a0319958) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:47 user nova-compute[75073]: INFO os_vif [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:3c:41,bridge_name='br-int',has_traffic_filtering=True,id=e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape970f3a3-8c')
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsYMQZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:42:47 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e24c63-fb03-4488-9266-e5f387e48919]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:42:47 user nova-compute[75073]: No targets found.
Nov 24 10:42:47 user nova-compute[75073]: iSNS:
Nov 24 10:42:47 user nova-compute[75073]: No targets found.
Nov 24 10:42:47 user nova-compute[75073]: STATIC:
Nov 24 10:42:47 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100
Nov 24 10:42:47 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:47 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:47 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:42:47 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:47 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:47 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:42:47 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:47 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:47 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:42:47 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:47 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:47 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323
Nov 24 10:42:47 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:42:47 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:42:47 user nova-compute[75073]: FIRMWARE:
Nov 24 10:42:47 user nova-compute[75073]: No targets found.
Nov 24 10:42:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:42:47 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:42:47 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bca2fd-2809-45a3-9b2f-776536d92b41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962feba-7d5e-461c-b6d7-69a69032093e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:42:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2403e32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323'): ({'sde'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Removing single pathed devices sde {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f8268-ef3f-48ce-a5f7-a40e5b1b7826]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca5d05-52d4-4142-aadf-a5fc176e4e0a]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flushing IO for device /dev/sde {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[047b2e77-8fe8-4b67-89bb-74cd3982ebb9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5ffaf-9cc2-485e-a171-272b6a126a0e]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] SCSI volumes sde have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4138ce2-9efd-490f-aae5-ac0cf15fb7df]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f4b3ee-7ece-4500-a9cf-806b8aa09fc3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260]
Nov 24 10:42:47 user nova-compute[75073]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323, portal: 172.16.0.220,3260] successful.
Nov 24 10:42:47 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d3bb69-f1c2-4283-9a4a-42e278ab0323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8eac3-533e-4511-939b-060e4bf28cd9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== disconnect_volume: return (321ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:42:47 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:42:47 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Deleting instance files /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89_del
Nov 24 10:42:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Deletion of /opt/stack/data/nova/instances/bb708d85-9c31-4401-a367-c94337fb3e89_del complete
Nov 24 10:42:48 user nova-compute[75073]: INFO nova.compute.manager [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:42:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance spawned successfully.
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:48 user nova-compute[75073]: WARNING nova.compute.manager [req-9abf96e9-5d20-43ee-9bcd-b6be02a0efae req-a6a5f425-20eb-4d35-b2e5-d53ee5811d24 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:42:48 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Took 0.42 seconds to deallocate network for instance.
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc1bbf25-aa9b-4a61-84f9-89ba29cf6c63 req-76b231a6-28b5-4359-bd45-aac9e55a71ae service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-deleted-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d00b5c6d-7425-4fcf-adeb-3e1ca3b42b10 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.572s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] Acquiring lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] Lock "bb708d85-9c31-4401-a367-c94337fb3e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] No waiting events found dispatching network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:42:49 user nova-compute[75073]: WARNING nova.compute.manager [req-df25b0ce-11a8-4702-8b3f-c4d6579ccfef req-6ec0a4ec-d535-4e64-b920-60dc874d2cd9 service nova] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Received unexpected event network-vif-plugged-e970f3a3-8c2e-409f-a13e-d2e1f0ab0b1a for instance with vm_state active and task_state deleting.
Nov 24 10:42:49 user nova-compute[75073]: INFO nova.compute.manager [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: bb708d85-9c31-4401-a367-c94337fb3e89] Took 0.81 seconds to detach 1 volumes for instance.
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:49 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Deleted allocations for instance bb708d85-9c31-4401-a367-c94337fb3e89
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-558ef061-c9f0-410e-95ba-9f902ec5e499 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "bb708d85-9c31-4401-a367-c94337fb3e89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.917s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:42:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:42:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:42:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:42:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=25.10317611694336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:42:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 06ed6f5a-958b-4414-9dbd-69641b193367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d5593503-6dec-4752-a76d-13357ef07dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 64349c82-852d-4bae-a78d-30a8cc2f6835 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:42:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updating instance_info_cache with network_info: [{"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-b0927891-6586-4c71-9c78-d1b5ed8a2a01" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:42:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:42:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:03 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-changed-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Refreshing instance network info cache due to event network-changed-93b19d86-b11d-41e3-a7fc-4e57a2924935. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] Acquiring lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] Acquired lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Refreshing network info cache for port 93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updated VIF entry in instance network info cache for port 93b19d86-b11d-41e3-a7fc-4e57a2924935. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG nova.network.neutron [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating instance_info_cache with network_info: [{"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-80457797-0208-4036-8cba-a0f7f96b3396 req-a7c9c40e-7fff-4c08-89ca-74044216271d service nova] Releasing lock "refresh_cache-64349c82-852d-4bae-a78d-30a8cc2f6835" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:10 user nova-compute[75073]: INFO nova.compute.manager [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Terminating instance
Nov 24 10:43:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-unplugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] No waiting events found dispatching network-vif-unplugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b11e5391-250a-4139-8d35-6ed91b315a93 req-0a6e4e88-040e-4135-a2f1-2fe95e0639e1 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-unplugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:11 user nova-compute[75073]: INFO nova.compute.manager [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Terminating instance
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Instance destroyed successfully.
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid 64349c82-852d-4bae-a78d-30a8cc2f6835 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-542421547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-542421547',id=32,image_ref='6f55b343-d616-41ba-890b-d2c9a4fcbc60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP5G6FLRrJuaR3zFxjWFlBg4wSc9tskzsKPWC56xtfs1ZvnkceQAKfNp7hAjzLijJxfkV/ufXFiw7ZOCX40xz5gkwIjMxHZptuUD0OwtpKtLPCbdSmt1ykpaue/WfaLEw==',key_name='tempest-keypair-731082022',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-0pnm88g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1949066801',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=64349c82-852d-4bae-a78d-30a8cc2f6835,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "address": "fa:16:3e:1a:fb:aa", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93b19d86-b1", "ovs_interfaceid": "93b19d86-b11d-41e3-a7fc-4e57a2924935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_vif [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93b19d86-b1, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a78c9eaf-80ab-4829-8c85-225ea5be6b36) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:11 user nova-compute[75073]: INFO os_vif [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:fb:aa,bridge_name='br-int',has_traffic_filtering=True,id=93b19d86-b11d-41e3-a7fc-4e57a2924935,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93b19d86-b1')
Nov 24 10:43:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfEwpocU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:43:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00da7b-c313-4102-b0a2-2b904ae35ce4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:43:11 user nova-compute[75073]: No targets found.
Nov 24 10:43:11 user nova-compute[75073]: iSNS:
Nov 24 10:43:11 user nova-compute[75073]: No targets found.
Nov 24 10:43:11 user nova-compute[75073]: STATIC:
Nov 24 10:43:11 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100
Nov 24 10:43:11 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:43:11 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:43:11 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:43:11 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:43:11 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:43:11 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:43:11 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:43:11 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:43:11 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:43:11 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:43:11 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:43:11 user nova-compute[75073]: FIRMWARE:
Nov 24 10:43:11 user nova-compute[75073]: No targets found.
Nov 24 10:43:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:43:11 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:43:11 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ac7e2-e85f-4a36-9935-4f304f292903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5709d84-3e9f-4bc1-9f0c-8ccf508bbbd8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:43:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 (non-flash)
Nov 24 10:43:11 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:43:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238110280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100'): ({'sdg'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdg {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a6a880-ce68-465a-b9a2-1f043516338f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145a99a-f97b-4f5b-82fc-8480c1390d74]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdg {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9e340-ef99-4a6f-aae6-493aafd3f056]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac19797-7d29-4da0-bc15-7e8d1f176a08]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdg have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d65e7-daa0-42b5-a42c-f3e3f025f6db]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:43:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03cb6e-336c-45f5-a711-c53d876637de]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260]
Nov 24 10:43:12 user nova-compute[75073]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100, portal: 172.16.0.220,3260] successful.
Nov 24 10:43:12 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1aac20-19fa-493e-89f2-b638fdd77100 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85559f-a28f-469c-b5b4-f733f0efce00]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (380ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Deleting instance files /opt/stack/data/nova/instances/64349c82-852d-4bae-a78d-30a8cc2f6835_del
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Deletion of /opt/stack/data/nova/instances/64349c82-852d-4bae-a78d-30a8cc2f6835_del complete
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Instance destroyed successfully.
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lazy-loading 'resources' on Instance uuid 06ed6f5a-958b-4414-9dbd-69641b193367 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1983557742',display_name='tempest-ServerActionsTestOtherA-server-1983557742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1983557742',id=13,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LMbjqiPeIhgYA06J5KxSMum+T1U+5GM32aNyrzM2Vt9dctTZ0Kr4pOqN+j6ODpUHqHwtqgvFXguEXW4mVZCYpkS0DpE9yu35oiDuUFWPYUwXUGWNJ/4aZ5vVMMY8e2Q==',key_name='tempest-keypair-1961382719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4665d407280c4667beadb1678e105480',ramdisk_id='',reservation_id='r-tmwv1x0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-371935856',owner_user_name='tempest-ServerActionsTestOtherA-371935856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd5f6353e344aa96a97235372632fd',uuid=06ed6f5a-958b-4414-9dbd-69641b193367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converting VIF {"id": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "address": "fa:16:3e:2c:d2:00", "network": {"id": "8bf04012-c831-448d-9421-f133eeccc47f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2112786719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4665d407280c4667beadb1678e105480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270f3e17-82", "ovs_interfaceid": "270f3e17-8211-4cd8-b238-50bcf82dc6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG os_vif [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap270f3e17-82, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6f559de-604c-4f65-b77c-0491b4161f53) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: INFO os_vif [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:00,bridge_name='br-int',has_traffic_filtering=True,id=270f3e17-8211-4cd8-b238-50bcf82dc6f1,network=Network(8bf04012-c831-448d-9421-f133eeccc47f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270f3e17-82')
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Deleting instance files /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367_del
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Deletion of /opt/stack/data/nova/instances/06ed6f5a-958b-4414-9dbd-69641b193367_del complete
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.compute.manager [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.compute.manager [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:12 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Took 0.58 seconds to deallocate network for instance.
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:13 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Took 0.81 seconds to deallocate network for instance.
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-d5ceb9e6-412f-4725-86c8-9d2db15fa77a req-da07a603-8c6a-4cd9-8f67-ee0198a09aae service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-deleted-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:13 user nova-compute[75073]: INFO nova.compute.manager [req-d5ceb9e6-412f-4725-86c8-9d2db15fa77a req-da07a603-8c6a-4cd9-8f67-ee0198a09aae service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Neutron deleted interface 93b19d86-b11d-41e3-a7fc-4e57a2924935; detaching it from the instance and deleting it from the info cache
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.network.neutron [req-d5ceb9e6-412f-4725-86c8-9d2db15fa77a req-da07a603-8c6a-4cd9-8f67-ee0198a09aae service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-d5ceb9e6-412f-4725-86c8-9d2db15fa77a req-da07a603-8c6a-4cd9-8f67-ee0198a09aae service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Detach interface failed, port_id=93b19d86-b11d-41e3-a7fc-4e57a2924935, reason: Instance 64349c82-852d-4bae-a78d-30a8cc2f6835 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Acquiring lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] No waiting events found dispatching network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:13 user nova-compute[75073]: WARNING nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Received unexpected event network-vif-plugged-93b19d86-b11d-41e3-a7fc-4e57a2924935 for instance with vm_state active and task_state deleting.
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-vif-unplugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] No waiting events found dispatching network-vif-unplugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:13 user nova-compute[75073]: WARNING nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received unexpected event network-vif-unplugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 for instance with vm_state deleted and task_state None.
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Acquiring lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] Lock "06ed6f5a-958b-4414-9dbd-69641b193367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] No waiting events found dispatching network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:13 user nova-compute[75073]: WARNING nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received unexpected event network-vif-plugged-270f3e17-8211-4cd8-b238-50bcf82dc6f1 for instance with vm_state deleted and task_state None.
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-79be4119-f514-4e45-9393-c3e229de1d0f req-c3156d44-e548-46f6-89a8-1fb3ed12b1a9 service nova] [instance: 06ed6f5a-958b-4414-9dbd-69641b193367] Received event network-vif-deleted-270f3e17-8211-4cd8-b238-50bcf82dc6f1 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:13 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Deleted allocations for instance 06ed6f5a-958b-4414-9dbd-69641b193367
Nov 24 10:43:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-309f78b0-58f3-4c17-b6fd-2375fb63fce4 tempest-ServerActionsTestOtherA-371935856 tempest-ServerActionsTestOtherA-371935856-project-member] Lock "06ed6f5a-958b-4414-9dbd-69641b193367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:13 user nova-compute[75073]: INFO nova.compute.manager [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Took 0.82 seconds to detach 1 volumes for instance.
Nov 24 10:43:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 64349c82-852d-4bae-a78d-30a8cc2f6835] Deleting volume: 4e1aac20-19fa-493e-89f2-b638fdd77100 {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:43:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:14 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:43:14 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:43:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:14 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance 64349c82-852d-4bae-a78d-30a8cc2f6835
Nov 24 10:43:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-96d022c7-d39a-463a-9d36-cccedb8c750d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "64349c82-852d-4bae-a78d-30a8cc2f6835" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.705s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquired lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG nova.network.neutron [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'info_cache' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:31 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Releasing lock "refresh_cache-d619711b-81f7-4a70-96a3-380c5f4b99be" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:43:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance destroyed successfully.
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'resources' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG os_vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b97624e-3d, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4baead16-28d6-454a-b856-e5fba7dd66aa) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:32 user nova-compute[75073]: INFO os_vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start _get_guest_xml network_info=[{"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'numa_topology' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:43:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'vcpu_model' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'pci_devices' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:43:32 user nova-compute[75073]:   <uuid>d619711b-81f7-4a70-96a3-380c5f4b99be</uuid>
Nov 24 10:43:32 user nova-compute[75073]:   <name>instance-00000018</name>
Nov 24 10:43:32 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:43:32 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:43:32 user nova-compute[75073]:   <metadata>
Nov 24 10:43:32 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:43:32 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeTestJSON-server-2047909114</nova:name>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:43:32</nova:creationTime>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:43:32 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:43:32 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:owner>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:user uuid="288a86b67b4f449faffbbfe208a2effe">tempest-AttachVolumeTestJSON-729242413-project-member</nova:user>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:project uuid="800195c134fc45b892777e8d8e1cb13e">tempest-AttachVolumeTestJSON-729242413</nova:project>
Nov 24 10:43:32 user nova-compute[75073]:       </nova:owner>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:43:32 user nova-compute[75073]:       <nova:ports>
Nov 24 10:43:32 user nova-compute[75073]:         <nova:port uuid="5b97624e-3d6d-48d3-8a02-50e9d17bb5c0">
Nov 24 10:43:32 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:43:32 user nova-compute[75073]:         </nova:port>
Nov 24 10:43:32 user nova-compute[75073]:       </nova:ports>
Nov 24 10:43:32 user nova-compute[75073]:     </nova:instance>
Nov 24 10:43:32 user nova-compute[75073]:   </metadata>
Nov 24 10:43:32 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:43:32 user nova-compute[75073]:     <system>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="serial">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="uuid">d619711b-81f7-4a70-96a3-380c5f4b99be</entry>
Nov 24 10:43:32 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:43:32 user nova-compute[75073]:     </system>
Nov 24 10:43:32 user nova-compute[75073]:   </sysinfo>
Nov 24 10:43:32 user nova-compute[75073]:   <os>
Nov 24 10:43:32 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:43:32 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:43:32 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:43:32 user nova-compute[75073]:   </os>
Nov 24 10:43:32 user nova-compute[75073]:   <features>
Nov 24 10:43:32 user nova-compute[75073]:     <acpi/>
Nov 24 10:43:32 user nova-compute[75073]:     <apic/>
Nov 24 10:43:32 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:43:32 user nova-compute[75073]:   </features>
Nov 24 10:43:32 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:43:32 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:43:32 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:43:32 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:43:32 user nova-compute[75073]:   </clock>
Nov 24 10:43:32 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:43:32 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:43:32 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:43:32 user nova-compute[75073]:   </cpu>
Nov 24 10:43:32 user nova-compute[75073]:   <devices>
Nov 24 10:43:32 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:43:32 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:43:32 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk"/>
Nov 24 10:43:32 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:43:32 user nova-compute[75073]:     </disk>
Nov 24 10:43:32 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:43:32 user nova-compute[75073]:       <mac address="fa:16:3e:d0:fd:eb"/>
Nov 24 10:43:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:43:32 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:43:32 user nova-compute[75073]:       <target dev="tap5b97624e-3d"/>
Nov 24 10:43:32 user nova-compute[75073]:     </interface>
Nov 24 10:43:32 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:43:32 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/console.log" append="off"/>
Nov 24 10:43:32 user nova-compute[75073]:     </serial>
Nov 24 10:43:32 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:43:32 user nova-compute[75073]:     <video>
Nov 24 10:43:32 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:43:32 user nova-compute[75073]:     </video>
Nov 24 10:43:32 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:43:32 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:43:32 user nova-compute[75073]:     </rng>
Nov 24 10:43:32 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:43:32 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:43:32 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:43:32 user nova-compute[75073]:     </memballoon>
Nov 24 10:43:32 user nova-compute[75073]:   </devices>
Nov 24 10:43:32 user nova-compute[75073]: </domain>
Nov 24 10:43:32 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'trusted_certs' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:43:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Cannot resize image /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'migration_context' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.objects.base [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Object Instance<d619711b-81f7-4a70-96a3-380c5f4b99be> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG os_vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '747ebf20-7d60-5943-ae3e-a4059238f4d6', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b97624e-3d, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b97624e-3d, col_values=(('qos', UUID('6dda4843-db9f-45c3-9098-7a253003c0ad')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b97624e-3d, col_values=(('external_ids', {'iface-id': '5b97624e-3d6d-48d3-8a02-50e9d17bb5c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fd:eb', 'vm-uuid': 'd619711b-81f7-4a70-96a3-380c5f4b99be'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:33 user nova-compute[75073]: INFO os_vif [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:43:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:34 user nova-compute[75073]: WARNING nova.compute.manager [req-0a503785-8196-423d-b8cc-385bf5ae3ca9 req-4ae9ca9b-11c2-4f9a-bfab-c09175cc49ae service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state stopped and task_state powering-on.
Nov 24 10:43:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:43:36 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance rebooted successfully.
Nov 24 10:43:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-e201fb99-9994-48b0-acf6-e6f02774934d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:36 user nova-compute[75073]: WARNING nova.compute.manager [req-feba607e-eb2d-4b4c-92bf-b8163af727d6 req-00f990c1-6311-4d24-8583-ed9525c2bd8d service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state active and task_state None.
Nov 24 10:43:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:37 user nova-compute[75073]: INFO nova.compute.manager [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Terminating instance
Nov 24 10:43:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Instance destroyed successfully.
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid 20f8c036-492d-4389-bffb-7b6e5c120f39 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-286272946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-286272946',id=23,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:34:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-pjr6n64h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:36:12Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=20f8c036-492d-4389-bffb-7b6e5c120f39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "address": "fa:16:3e:58:2b:80", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f723fb9-07", "ovs_interfaceid": "8f723fb9-078b-4ccc-b678-ed2649e9fdca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG os_vif [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f723fb9-07, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=088ece0c-39dc-433e-8302-dacbb3a29803) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:38 user nova-compute[75073]: INFO os_vif [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:2b:80,bridge_name='br-int',has_traffic_filtering=True,id=8f723fb9-078b-4ccc-b678-ed2649e9fdca,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f723fb9-07')
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Deleting instance files /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39_del
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Deletion of /opt/stack/data/nova/instances/20f8c036-492d-4389-bffb-7b6e5c120f39_del complete
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.compute.manager [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Took 0.43 seconds to deallocate network for instance.
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-5bec67d1-0604-4220-bae3-9ede5b3a0bb4 req-c26e1031-ad7e-4ec9-8d00-40cba6720b01 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-vif-deleted-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:38 user nova-compute[75073]: INFO nova.compute.manager [req-5bec67d1-0604-4220-bae3-9ede5b3a0bb4 req-c26e1031-ad7e-4ec9-8d00-40cba6720b01 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Neutron deleted interface 8f723fb9-078b-4ccc-b678-ed2649e9fdca; detaching it from the instance and deleting it from the info cache
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.network.neutron [req-5bec67d1-0604-4220-bae3-9ede5b3a0bb4 req-c26e1031-ad7e-4ec9-8d00-40cba6720b01 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-5bec67d1-0604-4220-bae3-9ede5b3a0bb4 req-c26e1031-ad7e-4ec9-8d00-40cba6720b01 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Detach interface failed, port_id=8f723fb9-078b-4ccc-b678-ed2649e9fdca, reason: Instance 20f8c036-492d-4389-bffb-7b6e5c120f39 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-vif-unplugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] No waiting events found dispatching network-vif-unplugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:38 user nova-compute[75073]: WARNING nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received unexpected event network-vif-unplugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca for instance with vm_state deleted and task_state None.
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Acquiring lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] No waiting events found dispatching network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:43:38 user nova-compute[75073]: WARNING nova.compute.manager [req-73db0c38-eaa0-4706-aa12-e5a41679a872 req-4eaff2cc-9319-4a25-ac81-b237a300c669 service nova] [instance: 20f8c036-492d-4389-bffb-7b6e5c120f39] Received unexpected event network-vif-plugged-8f723fb9-078b-4ccc-b678-ed2649e9fdca for instance with vm_state deleted and task_state None.
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:43:38 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:43:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:39 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Deleted allocations for instance 20f8c036-492d-4389-bffb-7b6e5c120f39
Nov 24 10:43:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da29e5ee-4634-4cf8-8a20-4f66b2d3140a tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "20f8c036-492d-4389-bffb-7b6e5c120f39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:43:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:43:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:43:51 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=25.238536834716797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 838112bb-7408-44a0-82f7-8606ac3f0d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d5593503-6dec-4752-a76d-13357ef07dce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:43:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:43:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:43:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:43:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:43:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:43:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:43:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:43:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:03 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:04 user nova-compute[75073]: INFO nova.compute.manager [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Terminating instance
Nov 24 10:44:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-168525c2-68b0-4bdd-a4c8-185a08d9a2c2 req-d74f994f-8363-468b-acd7-fad95e5dc725 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Instance destroyed successfully.
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid d5593503-6dec-4752-a76d-13357ef07dce {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1567393195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1567393195',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMabJECf7eS5WGqR3MpwmcQRv1OG1L2R3fK2TXnblA8AivUaTUHwKuv2aqbghXUVKxGMwY/vKqHRGx/iiUokyIM8c2XzNc5cHbUn1kMTYEQ1r7t0zKrpnmcYowfpwSTFVQ==',key_name='tempest-keypair-1382468796',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-r7f6fy7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=d5593503-6dec-4752-a76d-13357ef07dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "address": "fa:16:3e:f8:5c:bb", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ba066d6-15", "ovs_interfaceid": "3ba066d6-1530-4fc2-87aa-9d6305d418d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_vif [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ba066d6-15, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f30d685-4ab9-4963-8eb6-49746dc2cfb5) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: INFO os_vif [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5c:bb,bridge_name='br-int',has_traffic_filtering=True,id=3ba066d6-1530-4fc2-87aa-9d6305d418d6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ba066d6-15')
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvyakeSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:44:05 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d489136-cc58-4ded-81f0-d9ec223f967b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:44:05 user nova-compute[75073]: No targets found.
Nov 24 10:44:05 user nova-compute[75073]: iSNS:
Nov 24 10:44:05 user nova-compute[75073]: No targets found.
Nov 24 10:44:05 user nova-compute[75073]: STATIC:
Nov 24 10:44:05 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:44:05 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:05 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:05 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c
Nov 24 10:44:05 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:05 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:05 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:44:05 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:05 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:05 user nova-compute[75073]: FIRMWARE:
Nov 24 10:44:05 user nova-compute[75073]: No targets found.
Nov 24 10:44:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:44:05 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:44:05 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88e9148-3a3c-4886-b995-c3cd7613570e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e71cf4-5010-4e6b-8cdd-e8d4c0d8c01a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:44:05 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:44:05 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:44:05 user nova-compute[75073]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c (non-flash)
Nov 24 10:44:05 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238216c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe17e9-c076-444f-bbe3-ed772301ee4f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcebe522-733d-4324-9493-5fcbb7dcee5a]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fa0300-5679-4764-89ff-1272f1102b34]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a71c7-e5e7-40ae-8ff4-28af245a133d]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c6ca3-1ebc-4886-851a-14921311e779]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d808cd39-7414-468f-9b04-67699f12942f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260]
Nov 24 10:44:05 user nova-compute[75073]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c, portal: 172.16.0.220,3260] successful.
Nov 24 10:44:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58570d37-6c60-4974-a711-ea53683c800c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f8779-c5a0-4387-aa2a-f9f080250266]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (393ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:44:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Deleting instance files /opt/stack/data/nova/instances/d5593503-6dec-4752-a76d-13357ef07dce_del
Nov 24 10:44:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Deletion of /opt/stack/data/nova/instances/d5593503-6dec-4752-a76d-13357ef07dce_del complete
Nov 24 10:44:05 user nova-compute[75073]: INFO nova.compute.manager [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 24 10:44:05 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:44:06 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Took 1.14 seconds to deallocate network for instance.
Nov 24 10:44:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-f6e69f9d-cb8d-43fc-a355-bbc45e6b729a req-1c114359-1e56-4c49-bdc8-219382006b48 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-deleted-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:06 user nova-compute[75073]: WARNING nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state active and task_state deleting.
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:07 user nova-compute[75073]: WARNING nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state active and task_state deleting.
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:07 user nova-compute[75073]: WARNING nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state active and task_state deleting.
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-unplugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Acquiring lock "d5593503-6dec-4752-a76d-13357ef07dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] Lock "d5593503-6dec-4752-a76d-13357ef07dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] No waiting events found dispatching network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:07 user nova-compute[75073]: WARNING nova.compute.manager [req-a40a5f9c-ef9e-48ab-94b0-7ae94651fdbc req-96183e85-6433-417e-8ebc-f1f707946d43 service nova] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Received unexpected event network-vif-plugged-3ba066d6-1530-4fc2-87aa-9d6305d418d6 for instance with vm_state active and task_state deleting.
Nov 24 10:44:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:07 user nova-compute[75073]: INFO nova.compute.manager [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Took 0.81 seconds to detach 1 volumes for instance.
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: d5593503-6dec-4752-a76d-13357ef07dce] Deleting volume: 58570d37-6c60-4974-a711-ea53683c800c {{(pid=75073) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:07 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:44:08 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:44:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:08 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance d5593503-6dec-4752-a76d-13357ef07dce
Nov 24 10:44:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f548bf54-cf65-4b46-8cdb-9a41e3cf5001 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "d5593503-6dec-4752-a76d-13357ef07dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.698s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:20 user nova-compute[75073]: INFO nova.compute.manager [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Detaching volume 66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:44:20 user nova-compute[75073]: INFO nova.virt.block_device [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Attempting to driver detach volume 66286b42-d84f-41d7-8b19-b8b97e9f2bf4 from mountpoint /dev/vdc
Nov 24 10:44:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Attempting to detach device vdc from instance 5e71c06b-3545-4aaa-93f6-9279da1b838d from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:44:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:44:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:44:20 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:44:20 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:44:20 user nova-compute[75073]:   <serial>66286b42-d84f-41d7-8b19-b8b97e9f2bf4</serial>
Nov 24 10:44:20 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:44:20 user nova-compute[75073]: </disk>
Nov 24 10:44:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:44:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully detached device vdc from instance 5e71c06b-3545-4aaa-93f6-9279da1b838d from the persistent domain config.
Nov 24 10:44:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5e71c06b-3545-4aaa-93f6-9279da1b838d from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:44:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:44:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:44:20 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:44:20 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:44:20 user nova-compute[75073]:   <serial>66286b42-d84f-41d7-8b19-b8b97e9f2bf4</serial>
Nov 24 10:44:20 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 10:44:20 user nova-compute[75073]: </disk>
Nov 24 10:44:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:44:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:44:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:44:26 user nova-compute[75073]: INFO nova.compute.claims [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Claim successful on node user
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:44:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:44:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.policy [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd71e749d8a944f9bda8a3a4675e21a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09653049e51e496c9f34f8d8fb8a707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:44:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Creating image(s)
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "/opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "/opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "/opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk 1073741824" returned: 0 in 0.067s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Successfully created port: 99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Cannot resize image /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Ensure instance console log exists: /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:28 user nova-compute[75073]: INFO nova.compute.manager [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Terminating instance
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Successfully updated port: 99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquired lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-changed-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Refreshing instance network info cache due to event network-changed-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] Acquiring lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d14e52dd-9a2b-4576-8928-003a225f5e66 req-e8fd8df1-e195-4aa6-b241-5d165efb9d90 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-unplugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updating instance_info_cache with network_info: [{"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Releasing lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Instance network_info: |[{"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] Acquired lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Refreshing network info cache for port 99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Start _get_guest_xml network_info=[{"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:44:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:44:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642815116',display_name='tempest-VolumesActionsTest-instance-642815116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642815116',id=33,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-gya67kxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:44:27Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=e40cf594-cef1-4d95-9708-1f5d7205fee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lazy-loading 'pci_devices' on Instance uuid e40cf594-cef1-4d95-9708-1f5d7205fee3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:44:28 user nova-compute[75073]:   <uuid>e40cf594-cef1-4d95-9708-1f5d7205fee3</uuid>
Nov 24 10:44:28 user nova-compute[75073]:   <name>instance-00000021</name>
Nov 24 10:44:28 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:44:28 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:44:28 user nova-compute[75073]:   <metadata>
Nov 24 10:44:28 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:44:28 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:name>tempest-VolumesActionsTest-instance-642815116</nova:name>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:44:28</nova:creationTime>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:44:28 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:44:28 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:owner>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:user uuid="dd71e749d8a944f9bda8a3a4675e21a4">tempest-VolumesActionsTest-1874390497-project-member</nova:user>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:project uuid="09653049e51e496c9f34f8d8fb8a707f">tempest-VolumesActionsTest-1874390497</nova:project>
Nov 24 10:44:28 user nova-compute[75073]:       </nova:owner>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:44:28 user nova-compute[75073]:       <nova:ports>
Nov 24 10:44:28 user nova-compute[75073]:         <nova:port uuid="99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430">
Nov 24 10:44:28 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 10:44:28 user nova-compute[75073]:         </nova:port>
Nov 24 10:44:28 user nova-compute[75073]:       </nova:ports>
Nov 24 10:44:28 user nova-compute[75073]:     </nova:instance>
Nov 24 10:44:28 user nova-compute[75073]:   </metadata>
Nov 24 10:44:28 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:44:28 user nova-compute[75073]:     <system>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="serial">e40cf594-cef1-4d95-9708-1f5d7205fee3</entry>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="uuid">e40cf594-cef1-4d95-9708-1f5d7205fee3</entry>
Nov 24 10:44:28 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:44:28 user nova-compute[75073]:     </system>
Nov 24 10:44:28 user nova-compute[75073]:   </sysinfo>
Nov 24 10:44:28 user nova-compute[75073]:   <os>
Nov 24 10:44:28 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:44:28 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:44:28 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:44:28 user nova-compute[75073]:   </os>
Nov 24 10:44:28 user nova-compute[75073]:   <features>
Nov 24 10:44:28 user nova-compute[75073]:     <acpi/>
Nov 24 10:44:28 user nova-compute[75073]:     <apic/>
Nov 24 10:44:28 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:44:28 user nova-compute[75073]:   </features>
Nov 24 10:44:28 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:44:28 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:44:28 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:44:28 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:44:28 user nova-compute[75073]:   </clock>
Nov 24 10:44:28 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:44:28 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:44:28 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:44:28 user nova-compute[75073]:   </cpu>
Nov 24 10:44:28 user nova-compute[75073]:   <devices>
Nov 24 10:44:28 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:44:28 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:44:28 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk"/>
Nov 24 10:44:28 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:44:28 user nova-compute[75073]:     </disk>
Nov 24 10:44:28 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:44:28 user nova-compute[75073]:       <mac address="fa:16:3e:b6:e6:fa"/>
Nov 24 10:44:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:44:28 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:44:28 user nova-compute[75073]:       <target dev="tap99c08fe3-0a"/>
Nov 24 10:44:28 user nova-compute[75073]:     </interface>
Nov 24 10:44:28 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:44:28 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/console.log" append="off"/>
Nov 24 10:44:28 user nova-compute[75073]:     </serial>
Nov 24 10:44:28 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:44:28 user nova-compute[75073]:     <video>
Nov 24 10:44:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:44:28 user nova-compute[75073]:     </video>
Nov 24 10:44:28 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:44:28 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:44:28 user nova-compute[75073]:     </rng>
Nov 24 10:44:28 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:44:28 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:44:28 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:44:28 user nova-compute[75073]:     </memballoon>
Nov 24 10:44:28 user nova-compute[75073]:   </devices>
Nov 24 10:44:28 user nova-compute[75073]: </domain>
Nov 24 10:44:28 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642815116',display_name='tempest-VolumesActionsTest-instance-642815116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642815116',id=33,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-gya67kxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:44:27Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=e40cf594-cef1-4d95-9708-1f5d7205fee3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_vif [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb11c511-a54a-5ec1-b9e8-4fabded499d3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99c08fe3-0a, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99c08fe3-0a, col_values=(('qos', UUID('7bdb7351-5605-4ddc-ac1d-52d47f39d015')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99c08fe3-0a, col_values=(('external_ids', {'iface-id': '99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:e6:fa', 'vm-uuid': 'e40cf594-cef1-4d95-9708-1f5d7205fee3'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: INFO os_vif [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a')
Nov 24 10:44:28 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Instance destroyed successfully.
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.objects.instance [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid 838112bb-7408-44a0-82f7-8606ac3f0d86 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-533783566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-533783566',id=20,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-f5opil4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:32:28Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=838112bb-7408-44a0-82f7-8606ac3f0d86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "0d77945a-d179-483b-933d-55586c31e2c5", "address": "fa:16:3e:bd:10:67", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d77945a-d1", "ovs_interfaceid": "0d77945a-d179-483b-933d-55586c31e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_vif [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d77945a-d1, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] No VIF found with MAC fa:16:3e:b6:e6:fa, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f75d9f51-0597-45e3-8959-2e803e9cf913) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:28 user nova-compute[75073]: INFO os_vif [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:10:67,bridge_name='br-int',has_traffic_filtering=True,id=0d77945a-d179-483b-933d-55586c31e2c5,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d77945a-d1')
Nov 24 10:44:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTLgPjdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:44:28 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[634aa477-4e6c-4c82-a190-7fc9bf8d4a86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:44:28 user nova-compute[75073]: No targets found.
Nov 24 10:44:28 user nova-compute[75073]: iSNS:
Nov 24 10:44:28 user nova-compute[75073]: No targets found.
Nov 24 10:44:28 user nova-compute[75073]: STATIC:
Nov 24 10:44:28 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:44:28 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:28 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:28 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a
Nov 24 10:44:28 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:28 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:28 user nova-compute[75073]: FIRMWARE:
Nov 24 10:44:28 user nova-compute[75073]: No targets found.
Nov 24 10:44:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:44:28 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:44:28 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a40e0f-151b-46aa-8fbe-a2cb4e831dd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ad3e9-e9ea-42c1-ad27-8b6ea7a2e96d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:44:28 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a (non-flash)
Nov 24 10:44:28 user nova-compute[75073]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23847a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a'): ({'sdd'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Removing single pathed devices sdd {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:44:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f8d92-008f-42dd-ac11-27a67fc0be43]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb45a8-622a-43cd-9c31-cc14a42161de]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Flushing IO for device /dev/sdd {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updated VIF entry in instance network info cache for port 99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updating instance_info_cache with network_info: [{"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95355f-0f9d-41d3-ad20-7cf9dd87f2a6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5a1239c9-87fc-4b19-a21d-4eb522ed4498 req-3742cf84-a7bc-44fc-a40a-cc312ade8fa6 service nova] Releasing lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a5810-28fb-4114-9b23-ee17f905dd03]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[50928e3e-ea9e-45f0-8de1-bb360711db6c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a3a0f-db4c-4e3c-b5c8-aaa9d6d71eb8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260]
Nov 24 10:44:29 user nova-compute[75073]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a, portal: 172.16.0.220,3260] successful.
Nov 24 10:44:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a645bb30-96b7-4149-a9c6-3d7c6286422a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6802a-c960-4efb-903d-10cf4eb1cb79]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] <== disconnect_volume: return (260ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:44:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Deleting instance files /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86_del
Nov 24 10:44:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Deletion of /opt/stack/data/nova/instances/838112bb-7408-44a0-82f7-8606ac3f0d86_del complete
Nov 24 10:44:29 user nova-compute[75073]: INFO nova.compute.manager [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 24 10:44:29 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:44:29 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:44:29 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Took 0.42 seconds to deallocate network for instance.
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-c4ab2ee6-331e-49ca-8cbf-189db4e97333 req-a76bcc72-dc60-487c-ad0b-8010acd98734 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-deleted-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] Acquiring lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] No waiting events found dispatching network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:30 user nova-compute[75073]: WARNING nova.compute.manager [req-9dbbe35c-e278-44f0-9085-5a1f495432af req-e56a6098-8a05-4fd2-a7e7-b1c7c32b1442 service nova] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Received unexpected event network-vif-plugged-0d77945a-d179-483b-933d-55586c31e2c5 for instance with vm_state active and task_state deleting.
Nov 24 10:44:30 user nova-compute[75073]: INFO nova.compute.manager [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 838112bb-7408-44a0-82f7-8606ac3f0d86] Took 0.99 seconds to detach 1 volumes for instance.
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:44:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:30 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Deleted allocations for instance 838112bb-7408-44a0-82f7-8606ac3f0d86
Nov 24 10:44:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-df372275-de14-4ea3-a5d1-72cc2fd127b4 tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "838112bb-7408-44a0-82f7-8606ac3f0d86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.961s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:44:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Instance spawned successfully.
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] No waiting events found dispatching network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:32 user nova-compute[75073]: WARNING nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received unexpected event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 for instance with vm_state building and task_state spawning.
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] No waiting events found dispatching network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:44:32 user nova-compute[75073]: WARNING nova.compute.manager [req-51636120-c6a4-415d-8216-e3b5cd1ae196 req-48ff0054-d320-46d1-8f5d-2df0c307a8f8 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received unexpected event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 for instance with vm_state building and task_state spawning.
Nov 24 10:44:32 user nova-compute[75073]: INFO nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 24 10:44:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:44:32 user nova-compute[75073]: INFO nova.compute.manager [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Took 5.97 seconds to build instance.
Nov 24 10:44:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d7300018-0c36-495a-bc70-1b0280551775 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.148s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:41 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5e71c06b-3545-4aaa-93f6-9279da1b838d is timed out.
Nov 24 10:44:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully detached device vdc from instance 5e71c06b-3545-4aaa-93f6-9279da1b838d from the live domain config.
Nov 24 10:44:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWfcyIEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:44:41 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40240049-423f-4bf0-832a-f2ae13d02f4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:44:41 user nova-compute[75073]: No targets found.
Nov 24 10:44:41 user nova-compute[75073]: iSNS:
Nov 24 10:44:41 user nova-compute[75073]: No targets found.
Nov 24 10:44:41 user nova-compute[75073]: STATIC:
Nov 24 10:44:41 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4
Nov 24 10:44:41 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:44:41 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:44:41 user nova-compute[75073]: FIRMWARE:
Nov 24 10:44:41 user nova-compute[75073]: No targets found.
Nov 24 10:44:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:44:41 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:44:41 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b388c7e-e02a-4e23-ad7b-efe5152ca1ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6575185-a3ef-4ecf-8ab3-c3c15f3c07c2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 (non-flash)
Nov 24 10:44:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2402bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e53af-db86-489f-b75d-632fa9148269]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6597db-e15a-429e-802f-10b4e1525f44]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386dec8-a645-4bcd-95b4-b104fd3e2ca4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[01691d5f-bd9c-4afb-8949-dcc5661c8484]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba87b2d-af18-4fde-8144-5936cfe0e0b3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5eac6-a8fa-4b3a-b7ff-f992c16388b2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260]
Nov 24 10:44:41 user nova-compute[75073]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4, portal: 172.16.0.220,3260] successful.
Nov 24 10:44:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66286b42-d84f-41d7-8b19-b8b97e9f2bf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c1b1a8-1d40-41fe-8f5a-2b7ac43cbee2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] <== disconnect_volume: return (257ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:44:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:44:42 user nova-compute[75073]: DEBUG nova.objects.instance [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'flavor' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:44:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f6f080-3351-49d7-a6f0-4ddec95cbb07 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:44:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:44:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:44:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:44:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:44:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=25.200653076171875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5945a479-75dc-4018-a7cd-80c5ab25b67c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d619711b-81f7-4a70-96a3-380c5f4b99be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance e40cf594-cef1-4d95-9708-1f5d7205fee3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:44:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:44:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:56 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 5945a479-75dc-4018-a7cd-80c5ab25b67c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:44:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:44:59 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [{"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:44:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-5945a479-75dc-4018-a7cd-80c5ab25b67c" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:44:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:45:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:45:04 user nova-compute[75073]: INFO nova.compute.claims [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Claim successful on node user
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:45:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.policy [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:45:04 user nova-compute[75073]: INFO nova.virt.block_device [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Booting with volume 18c9bf5a-e01a-483a-bc7b-1cc4c246649e at /dev/vda
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.utils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcedaa56-af5f-44a1-8814-a362453a1bcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fc100-9c14-4239-8694-e0bac9fe3a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[603dc339-ddcd-4cd6-94f9-b7a2d24a2032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def9cb7-85c0-4509-8399-35df0ca93d90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:45:04 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:45:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc4bd98-51a8-44b3-9ade-8fd4bb42ea6b]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG os_brick.utils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:45:04 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updating existing volume attachment record: 2294ad88-f224-40e6-bd15-5a424ee546b6 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:45:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Successfully created port: bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Successfully updated port: bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-changed-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Refreshing instance network info cache due to event network-changed-bc651054-20f1-4167-ba94-907ea709cb30. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] Acquiring lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updating instance_info_cache with network_info: [{"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Instance network_info: |[{"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] Acquired lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:45:06 user nova-compute[75073]: DEBUG nova.network.neutron [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Refreshing network info cache for port bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:45:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updated VIF entry in instance network info cache for port bc651054-20f1-4167-ba94-907ea709cb30. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:45:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updating instance_info_cache with network_info: [{"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78fe5789-c6c2-407a-be69-b153f498db53 req-f1795ffc-318b-4dd6-a65c-163ccf3e3d72 service nova] Releasing lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:45:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:10 user nova-compute[75073]: INFO nova.compute.manager [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Terminating instance
Nov 24 10:45:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.compute.manager [req-b14acdfc-726b-4305-ace4-e9189fc1c0b9 req-c1027435-0c73-4e10-9569-cdbe18d929e8 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-unplugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:45:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Creating image(s)
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Ensure instance console log exists: /opt/stack/data/nova/instances/05994f94-634e-4feb-a19f-1b207a37aa67/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Start _get_guest_xml network_info=[{"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '2294ad88-f224-40e6-bd15-5a424ee546b6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05994f94-634e-4feb-a19f-1b207a37aa67', 'attached_at': '', 'detached_at': '', 'volume_id': '18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'serial': '18c9bf5a-e01a-483a-bc7b-1cc4c246649e'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:45:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:45:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:45:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:45:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:45:11 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e3957-bb15-4057-bdd1-db4e3621bb67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:45:11 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fcab98-0c0c-464f-9cf0-d30c2b3039e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e] added
Nov 24 10:45:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a496ab4-d966-4fa8-b4cf-3ee12492a3a1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c211d7-b8b6-4501-baca-a67e1109cfbd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjGhDinv {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjGhDinv" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac4f8f7-67aa-4868-8779-8e987c1a4668]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XjGhDinv'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f4373-6d4e-4ce5-90d8-7962adf2ed8a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b196c25-ff82-424e-a78e-e290e672b91b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:45:11 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:45:11 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:45:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:45:11 user nova-compute[75073]: 
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Instance destroyed successfully.
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'resources' on Instance uuid 5e71c06b-3545-4aaa-93f6-9279da1b838d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1404493724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1404493724',id=30,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI/t9ro4qAVlxLnzrPyeTU4eE2EY9h48fXpKzwePcqe7KIwljE+oAt0edhmHcw7f14WZVftt+5y8T2lehATO8OIcIPIMukV5DfuipVWVLQPBJpBfxzA46YukyHcE2qY9Q==',key_name='tempest-keypair-291933903',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:42:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-abtu1dy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=5e71c06b-3545-4aaa-93f6-9279da1b838d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "address": "fa:16:3e:eb:79:34", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaaf0de1-e8", "ovs_interfaceid": "eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_vif [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959075f-3d25-4d81-886e-01b4e89a9f14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]
Nov 24 10:45:11 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.
Nov 24 10:45:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaaf0de1-e8, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46cf5bec-6a97-4606-8a0d-b89922889e33) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:11 user nova-compute[75073]: INFO os_vif [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:79:34,bridge_name='br-int',has_traffic_filtering=True,id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaaf0de1-e8')
Nov 24 10:45:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Deleting instance files /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d_del
Nov 24 10:45:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Deletion of /opt/stack/data/nova/instances/5e71c06b-3545-4aaa-93f6-9279da1b838d_del complete
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ccf0b9-9243-49a9-a4fe-357893632e96]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda7c9f7-89b2-442c-883d-3a44c5adb2dd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:45:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:45:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[39acff4e-e980-488f-b861-b118f8e29315]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:45:11 user nova-compute[75073]: INFO nova.compute.manager [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 24 10:45:11 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:45:11 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:12 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Took 0.83 seconds to deallocate network for instance.
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-4af811c2-0f1d-4eca-8e31-219c67e8399a req-2c64f215-da90-4401-8a9d-2458cf142504 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-deleted-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:12 user nova-compute[75073]: INFO nova.compute.manager [req-4af811c2-0f1d-4eca-8e31-219c67e8399a req-2c64f215-da90-4401-8a9d-2458cf142504 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Neutron deleted interface eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643; detaching it from the instance and deleting it from the info cache
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-4af811c2-0f1d-4eca-8e31-219c67e8399a req-2c64f215-da90-4401-8a9d-2458cf142504 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.compute.manager [req-4af811c2-0f1d-4eca-8e31-219c67e8399a req-2c64f215-da90-4401-8a9d-2458cf142504 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Detach interface failed, port_id=eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643, reason: Instance 5e71c06b-3545-4aaa-93f6-9279da1b838d could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23861383664346362', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861383664346362', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1013087478',display_name='tempest-TestVolumeBootPattern-server-1013087478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1013087478',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-24ztpthv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:45:05Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=05994f94-634e-4feb-a19f-1b207a37aa67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid 05994f94-634e-4feb-a19f-1b207a37aa67 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:45:12 user nova-compute[75073]:   <uuid>05994f94-634e-4feb-a19f-1b207a37aa67</uuid>
Nov 24 10:45:12 user nova-compute[75073]:   <name>instance-00000022</name>
Nov 24 10:45:12 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:45:12 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:45:12 user nova-compute[75073]:   <metadata>
Nov 24 10:45:12 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:45:12 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:45:12 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-server-1013087478</nova:name>
Nov 24 10:45:12 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:45:11</nova:creationTime>
Nov 24 10:45:12 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:45:12 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:45:12 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:45:12 user nova-compute[75073]:       <nova:owner>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:45:12 user nova-compute[75073]:       </nova:owner>
Nov 24 10:45:12 user nova-compute[75073]:       <nova:ports>
Nov 24 10:45:12 user nova-compute[75073]:         <nova:port uuid="bc651054-20f1-4167-ba94-907ea709cb30">
Nov 24 10:45:12 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:45:12 user nova-compute[75073]:         </nova:port>
Nov 24 10:45:12 user nova-compute[75073]:       </nova:ports>
Nov 24 10:45:12 user nova-compute[75073]:     </nova:instance>
Nov 24 10:45:12 user nova-compute[75073]:   </metadata>
Nov 24 10:45:12 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:45:12 user nova-compute[75073]:     <system>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="serial">05994f94-634e-4feb-a19f-1b207a37aa67</entry>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="uuid">05994f94-634e-4feb-a19f-1b207a37aa67</entry>
Nov 24 10:45:12 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:45:12 user nova-compute[75073]:     </system>
Nov 24 10:45:12 user nova-compute[75073]:   </sysinfo>
Nov 24 10:45:12 user nova-compute[75073]:   <os>
Nov 24 10:45:12 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:45:12 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:45:12 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:45:12 user nova-compute[75073]:   </os>
Nov 24 10:45:12 user nova-compute[75073]:   <features>
Nov 24 10:45:12 user nova-compute[75073]:     <acpi/>
Nov 24 10:45:12 user nova-compute[75073]:     <apic/>
Nov 24 10:45:12 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:45:12 user nova-compute[75073]:   </features>
Nov 24 10:45:12 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:45:12 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:45:12 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:45:12 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:45:12 user nova-compute[75073]:   </clock>
Nov 24 10:45:12 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:45:12 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:45:12 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:45:12 user nova-compute[75073]:   </cpu>
Nov 24 10:45:12 user nova-compute[75073]:   <devices>
Nov 24 10:45:12 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:45:12 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:45:12 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:45:12 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:45:12 user nova-compute[75073]:       <serial>18c9bf5a-e01a-483a-bc7b-1cc4c246649e</serial>
Nov 24 10:45:12 user nova-compute[75073]:     </disk>
Nov 24 10:45:12 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:45:12 user nova-compute[75073]:       <mac address="fa:16:3e:28:c7:9c"/>
Nov 24 10:45:12 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:45:12 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:45:12 user nova-compute[75073]:       <target dev="tapbc651054-20"/>
Nov 24 10:45:12 user nova-compute[75073]:     </interface>
Nov 24 10:45:12 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:45:12 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/05994f94-634e-4feb-a19f-1b207a37aa67/console.log" append="off"/>
Nov 24 10:45:12 user nova-compute[75073]:     </serial>
Nov 24 10:45:12 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:45:12 user nova-compute[75073]:     <video>
Nov 24 10:45:12 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:45:12 user nova-compute[75073]:     </video>
Nov 24 10:45:12 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:45:12 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:45:12 user nova-compute[75073]:     </rng>
Nov 24 10:45:12 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:45:12 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:45:12 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:45:12 user nova-compute[75073]:     </memballoon>
Nov 24 10:45:12 user nova-compute[75073]:   </devices>
Nov 24 10:45:12 user nova-compute[75073]: </domain>
Nov 24 10:45:12 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1013087478',display_name='tempest-TestVolumeBootPattern-server-1013087478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1013087478',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-24ztpthv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:45:05Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=05994f94-634e-4feb-a19f-1b207a37aa67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG os_vif [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a52d73f0-3c7a-5895-9a7e-3c37bf42a2f0', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc651054-20, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc651054-20, col_values=(('qos', UUID('027bfdec-fa64-45fc-a10f-60120e3035fc')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc651054-20, col_values=(('external_ids', {'iface-id': 'bc651054-20f1-4167-ba94-907ea709cb30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:c7:9c', 'vm-uuid': '05994f94-634e-4feb-a19f-1b207a37aa67'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:12 user nova-compute[75073]: INFO os_vif [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20')
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:28:c7:9c, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:13 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Deleted allocations for instance 5e71c06b-3545-4aaa-93f6-9279da1b838d
Nov 24 10:45:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b007186d-dd45-4a54-8459-02798c89e48d tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] Acquiring lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] Lock "5e71c06b-3545-4aaa-93f6-9279da1b838d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] No waiting events found dispatching network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:13 user nova-compute[75073]: WARNING nova.compute.manager [req-52d34be7-8934-4da7-91b2-71f9959ba6f6 req-6ccfcf95-5501-4a78-8aa6-338a514c3b71 service nova] [instance: 5e71c06b-3545-4aaa-93f6-9279da1b838d] Received unexpected event network-vif-plugged-eaaf0de1-e8e1-4398-baf3-6f2b5b0ec643 for instance with vm_state deleted and task_state None.
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:14 user nova-compute[75073]: WARNING nova.compute.manager [req-e0fb104e-fd6d-4dd6-afcf-7f33596d33c4 req-1046c807-46d0-4d5c-9055-b6099348fee6 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state building and task_state spawning.
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.compute.manager [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Terminating instance
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:16 user nova-compute[75073]: WARNING nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state building and task_state spawning.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-unplugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] No waiting events found dispatching network-vif-unplugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-unplugged-81d58fe2-1825-4df2-a991-ed9e6632f371 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Acquiring lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] No waiting events found dispatching network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:16 user nova-compute[75073]: WARNING nova.compute.manager [req-53effbfb-c114-4dbc-9d5e-dea1c5d7588b req-d1a93f1c-2848-4e6d-9fac-dc2e5468a078 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received unexpected event network-vif-plugged-81d58fe2-1825-4df2-a991-ed9e6632f371 for instance with vm_state active and task_state deleting.
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Instance destroyed successfully.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lazy-loading 'resources' on Instance uuid b0927891-6586-4c71-9c78-d1b5ed8a2a01 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Instance spawned successfully.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:36:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1542362689',display_name='tempest-ServersNegativeTestJSON-server-1542362689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1542362689',id=27,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:36:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3eddcf7e79342b596d1f93d456051fa',ramdisk_id='',reservation_id='r-kvhws04z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-573004776',owner_user_name='tempest-ServersNegativeTestJSON-573004776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:36:37Z,user_data=None,user_id='7eb1e6d109f94de791496a9d1850d8b6',uuid=b0927891-6586-4c71-9c78-d1b5ed8a2a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converting VIF {"id": "81d58fe2-1825-4df2-a991-ed9e6632f371", "address": "fa:16:3e:27:56:d4", "network": {"id": "d1455b09-191c-4f29-b52c-30bf63ded722", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-733455888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3eddcf7e79342b596d1f93d456051fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d58fe2-18", "ovs_interfaceid": "81d58fe2-1825-4df2-a991-ed9e6632f371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG os_vif [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81d58fe2-18, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f98fbb1-c41f-4799-82b2-a0e38e052a3c) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:16 user nova-compute[75073]: INFO os_vif [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:56:d4,bridge_name='br-int',has_traffic_filtering=True,id=81d58fe2-1825-4df2-a991-ed9e6632f371,network=Network(d1455b09-191c-4f29-b52c-30bf63ded722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d58fe2-18')
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Deleting instance files /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01_del
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Deletion of /opt/stack/data/nova/instances/b0927891-6586-4c71-9c78-d1b5ed8a2a01_del complete
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.compute.manager [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:45:16 user nova-compute[75073]: INFO nova.compute.manager [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Took 12.56 seconds to build instance.
Nov 24 10:45:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a055065f-cf72-46bc-80d2-bf15bd1a10c9 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.659s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-58d67808-09de-48a5-91ab-ec8a4b38d696 req-a6276195-517f-4506-96e5-648db60ae957 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Received event network-vif-deleted-81d58fe2-1825-4df2-a991-ed9e6632f371 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:17 user nova-compute[75073]: INFO nova.compute.manager [req-58d67808-09de-48a5-91ab-ec8a4b38d696 req-a6276195-517f-4506-96e5-648db60ae957 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Neutron deleted interface 81d58fe2-1825-4df2-a991-ed9e6632f371; detaching it from the instance and deleting it from the info cache
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-58d67808-09de-48a5-91ab-ec8a4b38d696 req-a6276195-517f-4506-96e5-648db60ae957 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:17 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Took 0.50 seconds to deallocate network for instance.
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-58d67808-09de-48a5-91ab-ec8a4b38d696 req-a6276195-517f-4506-96e5-648db60ae957 service nova] [instance: b0927891-6586-4c71-9c78-d1b5ed8a2a01] Detach interface failed, port_id=81d58fe2-1825-4df2-a991-ed9e6632f371, reason: Instance b0927891-6586-4c71-9c78-d1b5ed8a2a01 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:17 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Deleted allocations for instance b0927891-6586-4c71-9c78-d1b5ed8a2a01
Nov 24 10:45:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-358fb06a-d02b-445b-b552-63eaf8279cbb tempest-ServersNegativeTestJSON-573004776 tempest-ServersNegativeTestJSON-573004776-project-member] Lock "b0927891-6586-4c71-9c78-d1b5ed8a2a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:18 user nova-compute[75073]: INFO nova.compute.manager [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Terminating instance
Nov 24 10:45:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-unplugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] No waiting events found dispatching network-vif-unplugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-unplugged-a4190797-2074-4344-b674-c772d33d7565 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Acquiring lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] No waiting events found dispatching network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:19 user nova-compute[75073]: WARNING nova.compute.manager [req-724e549a-8245-4f8d-b931-e2370e5cb66f req-47f3cd4a-b7b0-47a4-b653-3ad5f5224161 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received unexpected event network-vif-plugged-a4190797-2074-4344-b674-c772d33d7565 for instance with vm_state active and task_state deleting.
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Instance destroyed successfully.
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lazy-loading 'resources' on Instance uuid 5945a479-75dc-4018-a7cd-80c5ab25b67c {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:25:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1932737607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1932737607',id=14,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:25:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99debe1b1a2443eba2f955911465f648',ramdisk_id='',reservation_id='r-c1q9r6cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-822129086',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:27:39Z,user_data=None,user_id='b2c5754304104fec9f1af3afc52e6f98',uuid=5945a479-75dc-4018-a7cd-80c5ab25b67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converting VIF {"id": "a4190797-2074-4344-b674-c772d33d7565", "address": "fa:16:3e:43:19:9a", "network": {"id": "54c2096e-9d1a-495c-88cb-3a24beed15f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1344682785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99debe1b1a2443eba2f955911465f648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4190797-20", "ovs_interfaceid": "a4190797-2074-4344-b674-c772d33d7565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG os_vif [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4190797-20, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2961f486-0b55-4215-9e8e-39eabedb8464) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:19 user nova-compute[75073]: INFO os_vif [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=a4190797-2074-4344-b674-c772d33d7565,network=Network(54c2096e-9d1a-495c-88cb-3a24beed15f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4190797-20')
Nov 24 10:45:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Deleting instance files /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c_del
Nov 24 10:45:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Deletion of /opt/stack/data/nova/instances/5945a479-75dc-4018-a7cd-80c5ab25b67c_del complete
Nov 24 10:45:19 user nova-compute[75073]: INFO nova.compute.manager [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 24 10:45:19 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:45:19 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:45:20 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:20 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Took 0.45 seconds to deallocate network for instance.
Nov 24 10:45:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:20 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:20 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:20 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Deleted allocations for instance 5945a479-75dc-4018-a7cd-80c5ab25b67c
Nov 24 10:45:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-58f51f24-737b-4dd4-8fa6-6c56af06c81f tempest-ServerBootFromVolumeStableRescueTest-822129086 tempest-ServerBootFromVolumeStableRescueTest-822129086-project-member] Lock "5945a479-75dc-4018-a7cd-80c5ab25b67c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.697s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-ef062559-73fc-40fa-9276-240aa4c052ca req-0301cfbc-a380-43c9-baac-4f29127546b8 service nova] [instance: 5945a479-75dc-4018-a7cd-80c5ab25b67c] Received event network-vif-deleted-a4190797-2074-4344-b674-c772d33d7565 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:23 user nova-compute[75073]: INFO nova.compute.manager [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Terminating instance
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-6483dfa2-9682-487f-be0b-71eb4b54ee24 req-3f20e15a-e442-44dd-b23d-29bf741cc685 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-unplugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:45:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Instance destroyed successfully.
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.objects.instance [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'resources' on Instance uuid d619711b-81f7-4a70-96a3-380c5f4b99be {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:35:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2047909114',display_name='tempest-AttachVolumeTestJSON-server-2047909114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2047909114',id=24,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTA9NAAUMWeiRPy++9+f6xFDv7UoIqlgYZd5G2snktl6enA5p3D8ZJqlDG6E1HntRKmgCYClwzUHaGe3wn6uod2gHfxdGZeqli2e5oy8qZtklAycQ4xl85hWajNiWZXHg==',key_name='tempest-keypair-1001298245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:35:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-giqi1sju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=d619711b-81f7-4a70-96a3-380c5f4b99be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "address": "fa:16:3e:d0:fd:eb", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b97624e-3d", "ovs_interfaceid": "5b97624e-3d6d-48d3-8a02-50e9d17bb5c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG os_vif [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b97624e-3d, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dda4843-db9f-45c3-9098-7a253003c0ad) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:23 user nova-compute[75073]: INFO os_vif [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fd:eb,bridge_name='br-int',has_traffic_filtering=True,id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b97624e-3d')
Nov 24 10:45:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Deleting instance files /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be_del
Nov 24 10:45:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Deletion of /opt/stack/data/nova/instances/d619711b-81f7-4a70-96a3-380c5f4b99be_del complete
Nov 24 10:45:23 user nova-compute[75073]: INFO nova.compute.manager [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 24 10:45:23 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:45:23 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:24 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Took 0.63 seconds to deallocate network for instance.
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-88cdeef8-42b8-43f9-a625-b9ae2d54dc26 req-baed105b-3f9f-4fe6-86f2-51d308d60b08 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-deleted-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:24 user nova-compute[75073]: INFO nova.compute.manager [req-88cdeef8-42b8-43f9-a625-b9ae2d54dc26 req-baed105b-3f9f-4fe6-86f2-51d308d60b08 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Neutron deleted interface 5b97624e-3d6d-48d3-8a02-50e9d17bb5c0; detaching it from the instance and deleting it from the info cache
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.network.neutron [req-88cdeef8-42b8-43f9-a625-b9ae2d54dc26 req-baed105b-3f9f-4fe6-86f2-51d308d60b08 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.compute.manager [req-88cdeef8-42b8-43f9-a625-b9ae2d54dc26 req-baed105b-3f9f-4fe6-86f2-51d308d60b08 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Detach interface failed, port_id=5b97624e-3d6d-48d3-8a02-50e9d17bb5c0, reason: Instance d619711b-81f7-4a70-96a3-380c5f4b99be could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:24 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Deleted allocations for instance d619711b-81f7-4a70-96a3-380c5f4b99be
Nov 24 10:45:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2e1c618b-e62f-4b33-ad0a-6f27d688e561 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:45:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] Acquiring lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] Lock "d619711b-81f7-4a70-96a3-380c5f4b99be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] No waiting events found dispatching network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:45:25 user nova-compute[75073]: WARNING nova.compute.manager [req-9ed09724-d028-47e3-8a4e-1ed809f9e087 req-90b4cd55-379a-463d-8cbe-023cafe0aae2 service nova] [instance: d619711b-81f7-4a70-96a3-380c5f4b99be] Received unexpected event network-vif-plugged-5b97624e-3d6d-48d3-8a02-50e9d17bb5c0 for instance with vm_state deleted and task_state None.
Nov 24 10:45:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:45:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:45:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:45:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.40544891357422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance e40cf594-cef1-4d95-9708-1f5d7205fee3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 05994f94-634e-4feb-a19f-1b207a37aa67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:45:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:45:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:45:58 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:45:59 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updating instance_info_cache with network_info: [{"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:45:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-e40cf594-cef1-4d95-9708-1f5d7205fee3" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:45:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:46:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:46:04 user nova-compute[75073]: INFO nova.compute.claims [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Claim successful on node user
Nov 24 10:46:04 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:46:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.policy [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e546129896f04ea89b745a89af5d8519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ada50f2ea94c2286e5986bbf106f53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:46:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Creating image(s)
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.223s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk 1073741824" returned: 0 in 0.049s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Successfully created port: bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:46:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Cannot resize image /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Ensure instance console log exists: /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Successfully updated port: bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing instance network info cache due to event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance network_info: |[{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.neutron [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start _get_guest_xml network_info=[{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:46:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMqLy/3vopOEWpNCQB/yRTgw2DZ7E5aiOMVVK3a51LaH/n6ltd3dFS2XB4DuYo7c1V5vhomJlFhwRStmQitredXlT+ptcMrRm59m31Ew6R3H9lT3x741GYYG15OE7eYw==',key_name='tempest-keypair-433871786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_devices' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:46:06 user nova-compute[75073]:   <uuid>c72a667c-efdb-46fa-b3dc-1a168caec542</uuid>
Nov 24 10:46:06 user nova-compute[75073]:   <name>instance-00000023</name>
Nov 24 10:46:06 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:46:06 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:46:06 user nova-compute[75073]:   <metadata>
Nov 24 10:46:06 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:46:06 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1864752710</nova:name>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:46:06</nova:creationTime>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:46:06 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:46:06 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:owner>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:user uuid="e546129896f04ea89b745a89af5d8519">tempest-AttachVolumeShelveTestJSON-435396144-project-member</nova:user>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:project uuid="51ada50f2ea94c2286e5986bbf106f53">tempest-AttachVolumeShelveTestJSON-435396144</nova:project>
Nov 24 10:46:06 user nova-compute[75073]:       </nova:owner>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:46:06 user nova-compute[75073]:       <nova:ports>
Nov 24 10:46:06 user nova-compute[75073]:         <nova:port uuid="bbd06bda-805c-45a9-9521-d506d6923e28">
Nov 24 10:46:06 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:46:06 user nova-compute[75073]:         </nova:port>
Nov 24 10:46:06 user nova-compute[75073]:       </nova:ports>
Nov 24 10:46:06 user nova-compute[75073]:     </nova:instance>
Nov 24 10:46:06 user nova-compute[75073]:   </metadata>
Nov 24 10:46:06 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:46:06 user nova-compute[75073]:     <system>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="serial">c72a667c-efdb-46fa-b3dc-1a168caec542</entry>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="uuid">c72a667c-efdb-46fa-b3dc-1a168caec542</entry>
Nov 24 10:46:06 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:46:06 user nova-compute[75073]:     </system>
Nov 24 10:46:06 user nova-compute[75073]:   </sysinfo>
Nov 24 10:46:06 user nova-compute[75073]:   <os>
Nov 24 10:46:06 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:46:06 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:46:06 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:46:06 user nova-compute[75073]:   </os>
Nov 24 10:46:06 user nova-compute[75073]:   <features>
Nov 24 10:46:06 user nova-compute[75073]:     <acpi/>
Nov 24 10:46:06 user nova-compute[75073]:     <apic/>
Nov 24 10:46:06 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:46:06 user nova-compute[75073]:   </features>
Nov 24 10:46:06 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:46:06 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:46:06 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:46:06 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:46:06 user nova-compute[75073]:   </clock>
Nov 24 10:46:06 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:46:06 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:46:06 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:46:06 user nova-compute[75073]:   </cpu>
Nov 24 10:46:06 user nova-compute[75073]:   <devices>
Nov 24 10:46:06 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:46:06 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:46:06 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk"/>
Nov 24 10:46:06 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:46:06 user nova-compute[75073]:     </disk>
Nov 24 10:46:06 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:46:06 user nova-compute[75073]:       <mac address="fa:16:3e:2f:14:7e"/>
Nov 24 10:46:06 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:46:06 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:46:06 user nova-compute[75073]:       <target dev="tapbbd06bda-80"/>
Nov 24 10:46:06 user nova-compute[75073]:     </interface>
Nov 24 10:46:06 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:46:06 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/console.log" append="off"/>
Nov 24 10:46:06 user nova-compute[75073]:     </serial>
Nov 24 10:46:06 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:46:06 user nova-compute[75073]:     <video>
Nov 24 10:46:06 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:46:06 user nova-compute[75073]:     </video>
Nov 24 10:46:06 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:46:06 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:46:06 user nova-compute[75073]:     </rng>
Nov 24 10:46:06 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:46:06 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:46:06 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:46:06 user nova-compute[75073]:     </memballoon>
Nov 24 10:46:06 user nova-compute[75073]:   </devices>
Nov 24 10:46:06 user nova-compute[75073]: </domain>
Nov 24 10:46:06 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMqLy/3vopOEWpNCQB/yRTgw2DZ7E5aiOMVVK3a51LaH/n6ltd3dFS2XB4DuYo7c1V5vhomJlFhwRStmQitredXlT+ptcMrRm59m31Ew6R3H9lT3x741GYYG15OE7eYw==',key_name='tempest-keypair-433871786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG os_vif [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49f99ee9-a293-50ee-b343-bf9c59efc39c', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbd06bda-80, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbd06bda-80, col_values=(('qos', UUID('d7ed02b3-9228-44c1-9050-66e6bcab9db9')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbd06bda-80, col_values=(('external_ids', {'iface-id': 'bbd06bda-805c-45a9-9521-d506d6923e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:14:7e', 'vm-uuid': 'c72a667c-efdb-46fa-b3dc-1a168caec542'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:06 user nova-compute[75073]: INFO os_vif [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80')
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:46:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No VIF found with MAC fa:16:3e:2f:14:7e, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:46:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updated VIF entry in instance network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:46:07 user nova-compute[75073]: DEBUG nova.network.neutron [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ddb96f1-87ab-471d-9718-ec57b9821695 req-9978eaae-6fb0-43d5-8a91-aaedafaa840e service nova] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:08 user nova-compute[75073]: WARNING nova.compute.manager [req-c09b4970-1a84-4fb5-b4c2-4985793417ba req-d5868f8c-9eb5-4b03-a0f4-d68a5ced4fd8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state building and task_state spawning.
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:46:10 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance spawned successfully.
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:10 user nova-compute[75073]: INFO nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:46:10 user nova-compute[75073]: INFO nova.compute.manager [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Took 5.85 seconds to build instance.
Nov 24 10:46:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d64e6ab3-7f9a-4d53-934c-6f7fd2739196 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.961s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:10 user nova-compute[75073]: WARNING nova.compute.manager [req-032758f3-d9ca-4ab2-8365-4eb7c97144b9 req-ddb4715a-caad-4cf0-b003-973bae5ed9bd service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state active and task_state None.
Nov 24 10:46:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:16 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:46:16 user nova-compute[75073]: INFO nova.compute.claims [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Claim successful on node user
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:46:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:46:17 user nova-compute[75073]: INFO nova.compute.manager [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Terminating instance
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.policy [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '288a86b67b4f449faffbbfe208a2effe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800195c134fc45b892777e8d8e1cb13e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:46:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Creating image(s)
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "/opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "/opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-unplugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] No waiting events found dispatching network-vif-unplugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca3bde6c-15d3-40c3-96fa-e1ad385da77c req-4983427d-ea58-4e21-8ca4-15ff183e36b7 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-unplugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.211s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.225s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk 1073741824" returned: 0 in 0.067s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Successfully created port: 1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:46:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Instance destroyed successfully.
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lazy-loading 'resources' on Instance uuid e40cf594-cef1-4d95-9708-1f5d7205fee3 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:44:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642815116',display_name='tempest-VolumesActionsTest-instance-642815116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642815116',id=33,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-gya67kxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:44:33Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=e40cf594-cef1-4d95-9708-1f5d7205fee3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "address": "fa:16:3e:b6:e6:fa", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99c08fe3-0a", "ovs_interfaceid": "99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG os_vif [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99c08fe3-0a, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bdb7351-5605-4ddc-ac1d-52d47f39d015) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:18 user nova-compute[75073]: INFO os_vif [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99c08fe3-0a')
Nov 24 10:46:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Deleting instance files /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3_del
Nov 24 10:46:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Deletion of /opt/stack/data/nova/instances/e40cf594-cef1-4d95-9708-1f5d7205fee3_del complete
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.233s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:18 user nova-compute[75073]: INFO nova.compute.manager [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Cannot resize image /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Ensure instance console log exists: /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Successfully updated port: 1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquired lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-changed-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Refreshing instance network info cache due to event network-changed-1f8e74d4-bda7-4851-b4f7-472ed36e5950. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] Acquiring lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:46:18 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:18 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Took 0.64 seconds to deallocate network for instance.
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating instance_info_cache with network_info: [{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Releasing lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Instance network_info: |[{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] Acquired lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Refreshing network info cache for port 1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Start _get_guest_xml network_info=[{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:46:19 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Deleted allocations for instance e40cf594-cef1-4d95-9708-1f5d7205fee3
Nov 24 10:46:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-302995548',display_name='tempest-AttachVolumeTestJSON-server-302995548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-302995548',id=36,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlRdKkkmNHexFl0IMOKw4yUhWu1vm2U4qZZZ4p6J/BSEy6utm6Tq9nGiCCtM6EO7ErWuTKt0xR3tFNMcejpSa9pwMCIWqF7ksSRhy7k2veaIGWyaLcnDdhGKF4znUa49Q==',key_name='tempest-keypair-251586635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-qc0ltqsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=a9b8cc9d-0b5b-468b-ad86-fda2da4a253b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.objects.instance [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'pci_devices' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:46:19 user nova-compute[75073]:   <uuid>a9b8cc9d-0b5b-468b-ad86-fda2da4a253b</uuid>
Nov 24 10:46:19 user nova-compute[75073]:   <name>instance-00000024</name>
Nov 24 10:46:19 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:46:19 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:46:19 user nova-compute[75073]:   <metadata>
Nov 24 10:46:19 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:46:19 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeTestJSON-server-302995548</nova:name>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:46:19</nova:creationTime>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:46:19 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:46:19 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:owner>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:user uuid="288a86b67b4f449faffbbfe208a2effe">tempest-AttachVolumeTestJSON-729242413-project-member</nova:user>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:project uuid="800195c134fc45b892777e8d8e1cb13e">tempest-AttachVolumeTestJSON-729242413</nova:project>
Nov 24 10:46:19 user nova-compute[75073]:       </nova:owner>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:46:19 user nova-compute[75073]:       <nova:ports>
Nov 24 10:46:19 user nova-compute[75073]:         <nova:port uuid="1f8e74d4-bda7-4851-b4f7-472ed36e5950">
Nov 24 10:46:19 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 10:46:19 user nova-compute[75073]:         </nova:port>
Nov 24 10:46:19 user nova-compute[75073]:       </nova:ports>
Nov 24 10:46:19 user nova-compute[75073]:     </nova:instance>
Nov 24 10:46:19 user nova-compute[75073]:   </metadata>
Nov 24 10:46:19 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:46:19 user nova-compute[75073]:     <system>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="serial">a9b8cc9d-0b5b-468b-ad86-fda2da4a253b</entry>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="uuid">a9b8cc9d-0b5b-468b-ad86-fda2da4a253b</entry>
Nov 24 10:46:19 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:46:19 user nova-compute[75073]:     </system>
Nov 24 10:46:19 user nova-compute[75073]:   </sysinfo>
Nov 24 10:46:19 user nova-compute[75073]:   <os>
Nov 24 10:46:19 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:46:19 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:46:19 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:46:19 user nova-compute[75073]:   </os>
Nov 24 10:46:19 user nova-compute[75073]:   <features>
Nov 24 10:46:19 user nova-compute[75073]:     <acpi/>
Nov 24 10:46:19 user nova-compute[75073]:     <apic/>
Nov 24 10:46:19 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:46:19 user nova-compute[75073]:   </features>
Nov 24 10:46:19 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:46:19 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:46:19 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:46:19 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:46:19 user nova-compute[75073]:   </clock>
Nov 24 10:46:19 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:46:19 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:46:19 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:46:19 user nova-compute[75073]:   </cpu>
Nov 24 10:46:19 user nova-compute[75073]:   <devices>
Nov 24 10:46:19 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:46:19 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:46:19 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk"/>
Nov 24 10:46:19 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:46:19 user nova-compute[75073]:     </disk>
Nov 24 10:46:19 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:46:19 user nova-compute[75073]:       <mac address="fa:16:3e:9f:c5:86"/>
Nov 24 10:46:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:46:19 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:46:19 user nova-compute[75073]:       <target dev="tap1f8e74d4-bd"/>
Nov 24 10:46:19 user nova-compute[75073]:     </interface>
Nov 24 10:46:19 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:46:19 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/console.log" append="off"/>
Nov 24 10:46:19 user nova-compute[75073]:     </serial>
Nov 24 10:46:19 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:46:19 user nova-compute[75073]:     <video>
Nov 24 10:46:19 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:46:19 user nova-compute[75073]:     </video>
Nov 24 10:46:19 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:46:19 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:46:19 user nova-compute[75073]:     </rng>
Nov 24 10:46:19 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:46:19 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:46:19 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:46:19 user nova-compute[75073]:     </memballoon>
Nov 24 10:46:19 user nova-compute[75073]:   </devices>
Nov 24 10:46:19 user nova-compute[75073]: </domain>
Nov 24 10:46:19 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-302995548',display_name='tempest-AttachVolumeTestJSON-server-302995548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-302995548',id=36,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlRdKkkmNHexFl0IMOKw4yUhWu1vm2U4qZZZ4p6J/BSEy6utm6Tq9nGiCCtM6EO7ErWuTKt0xR3tFNMcejpSa9pwMCIWqF7ksSRhy7k2veaIGWyaLcnDdhGKF4znUa49Q==',key_name='tempest-keypair-251586635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-qc0ltqsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=a9b8cc9d-0b5b-468b-ad86-fda2da4a253b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG os_vif [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31fe0914-0a72-5aa7-a38d-7cb51eafe9e3', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0382431-9e83-435b-a83b-1b341aa9d761 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f8e74d4-bd, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f8e74d4-bd, col_values=(('qos', UUID('f6327a08-2c15-47e2-abd3-2c34f3bd5d51')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f8e74d4-bd, col_values=(('external_ids', {'iface-id': '1f8e74d4-bda7-4851-b4f7-472ed36e5950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:c5:86', 'vm-uuid': 'a9b8cc9d-0b5b-468b-ad86-fda2da4a253b'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:19 user nova-compute[75073]: INFO os_vif [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd')
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No VIF found with MAC fa:16:3e:9f:c5:86, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] Acquiring lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] Lock "e40cf594-cef1-4d95-9708-1f5d7205fee3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] No waiting events found dispatching network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:19 user nova-compute[75073]: WARNING nova.compute.manager [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received unexpected event network-vif-plugged-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 for instance with vm_state deleted and task_state None.
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-970c0f43-8a7f-4afb-92f8-296edc26f119 req-298e22e8-955a-45d3-8c45-fbca1d2003c3 service nova] [instance: e40cf594-cef1-4d95-9708-1f5d7205fee3] Received event network-vif-deleted-99c08fe3-0a5e-4f1f-8f92-64dd4b2b6430 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updated VIF entry in instance network info cache for port 1f8e74d4-bda7-4851-b4f7-472ed36e5950. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG nova.network.neutron [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating instance_info_cache with network_info: [{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ac53ff80-893e-48c2-a870-5038f3a79d58 req-965d3f58-5472-4a2f-b2ab-b28326ed197e service nova] Releasing lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:46:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] No waiting events found dispatching network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:21 user nova-compute[75073]: WARNING nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received unexpected event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 for instance with vm_state building and task_state spawning.
Nov 24 10:46:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] No waiting events found dispatching network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:21 user nova-compute[75073]: WARNING nova.compute.manager [req-34689f08-e3b6-449c-b169-d93a9f826112 req-a4c9d568-0799-4b8c-a452-ce0de36c33c1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received unexpected event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 for instance with vm_state building and task_state spawning.
Nov 24 10:46:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:46:23 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Instance spawned successfully.
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:46:23 user nova-compute[75073]: INFO nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 24 10:46:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:46:23 user nova-compute[75073]: INFO nova.compute.manager [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Took 6.65 seconds to build instance.
Nov 24 10:46:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-26c346b7-b179-471b-b51d-74ba83788b86 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.766s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:46:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:54 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:54 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8492MB free_disk=25.36298370361328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 05994f94-634e-4feb-a19f-1b207a37aa67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c72a667c-efdb-46fa-b3dc-1a168caec542 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:46:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-changed-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Refreshing instance network info cache due to event network-changed-bc651054-20f1-4167-ba94-907ea709cb30. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] Acquiring lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] Acquired lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:46:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Refreshing network info cache for port bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:57 user nova-compute[75073]: INFO nova.compute.manager [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Terminating instance
Nov 24 10:46:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updated VIF entry in instance network info cache for port bc651054-20f1-4167-ba94-907ea709cb30. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updating instance_info_cache with network_info: [{"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f84448ab-a16f-4a5b-b88b-7c6f8727561e req-a144e753-25c2-48f1-92df-e1fc209a565f service nova] Releasing lock "refresh_cache-05994f94-634e-4feb-a19f-1b207a37aa67" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Instance destroyed successfully.
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid 05994f94-634e-4feb-a19f-1b207a37aa67 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-0972a77d-a8ee-4947-92cf-a5682a3964f1 req-55330797-1706-40ee-b55e-53322cf59a53 service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1013087478',display_name='tempest-TestVolumeBootPattern-server-1013087478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1013087478',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-24ztpthv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:45:17Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=05994f94-634e-4feb-a19f-1b207a37aa67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "bc651054-20f1-4167-ba94-907ea709cb30", "address": "fa:16:3e:28:c7:9c", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc651054-20", "ovs_interfaceid": "bc651054-20f1-4167-ba94-907ea709cb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_vif [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc651054-20, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=027bfdec-fa64-45fc-a10f-60120e3035fc) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: INFO os_vif [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c7:9c,bridge_name='br-int',has_traffic_filtering=True,id=bc651054-20f1-4167-ba94-907ea709cb30,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc651054-20')
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:46:58 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0615bf2-dcf3-4eed-a2bd-7eda38c728f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:46:58 user nova-compute[75073]: No targets found.
Nov 24 10:46:58 user nova-compute[75073]: iSNS:
Nov 24 10:46:58 user nova-compute[75073]: No targets found.
Nov 24 10:46:58 user nova-compute[75073]: STATIC:
Nov 24 10:46:58 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e
Nov 24 10:46:58 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:46:58 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:46:58 user nova-compute[75073]: FIRMWARE:
Nov 24 10:46:58 user nova-compute[75073]: No targets found.
Nov 24 10:46:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:46:58 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:46:58 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b14da-8d2d-4a89-9dd4-27080ae2a280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7de5d1c-1d24-4e5f-bdb7-389612c51e8f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:46:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:46:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382cfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b190e79-2f2f-4fe2-b878-eea697f271de]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec39208-fd4c-49a7-9096-bc639df1a6ae]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df916998-7eb5-4067-b76e-2db869458d78]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e48e69c-7a8f-4e93-adf6-53837b0f9372]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_864d70a7', '/dev/disk/by-id/scsi-1SCST_BIO864d70a7-8a86d4cbe413bae1', '/dev/disk/by-id/scsi-23861383664346362') {{(pid=85267) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fb02e1-fdcb-45b2-a427-de0ac1139eb6]: (4, None) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cde246-38c4-4714-9794-4ea9b7dcc13b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6829007-e724-4f0b-a710-409c5ad456d0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]
Nov 24 10:46:58 user nova-compute[75073]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.
Nov 24 10:46:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c44019-f969-4a77-b79b-147adde7112b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (355ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:46:58 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Deleting instance files /opt/stack/data/nova/instances/05994f94-634e-4feb-a19f-1b207a37aa67_del
Nov 24 10:46:58 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Deletion of /opt/stack/data/nova/instances/05994f94-634e-4feb-a19f-1b207a37aa67_del complete
Nov 24 10:46:58 user nova-compute[75073]: INFO nova.compute.manager [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 24 10:46:58 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:46:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:00 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Took 1.50 seconds to deallocate network for instance.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:00 user nova-compute[75073]: WARNING nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state active and task_state deleting.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:00 user nova-compute[75073]: WARNING nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state active and task_state deleting.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:00 user nova-compute[75073]: WARNING nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state active and task_state deleting.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-unplugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Acquiring lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] Lock "05994f94-634e-4feb-a19f-1b207a37aa67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] No waiting events found dispatching network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:00 user nova-compute[75073]: WARNING nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received unexpected event network-vif-plugged-bc651054-20f1-4167-ba94-907ea709cb30 for instance with vm_state active and task_state deleting.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-baa61c83-94b7-4af2-83cc-ebd09a73e6f3 req-1c8c7e5f-5151-4e3b-90d2-a9f93882db9b service nova] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Received event network-vif-deleted-bc651054-20f1-4167-ba94-907ea709cb30 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:47:00 user nova-compute[75073]: INFO nova.compute.manager [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 05994f94-634e-4feb-a19f-1b207a37aa67] Took 0.79 seconds to detach 1 volumes for instance.
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:47:01 user nova-compute[75073]: INFO nova.compute.claims [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Claim successful on node user
Nov 24 10:47:01 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance 05994f94-634e-4feb-a19f-1b207a37aa67
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d721d69b-0f45-43ab-b237-4b04fae42e96 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "05994f94-634e-4feb-a19f-1b207a37aa67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.042s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:47:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.policy [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7052a6daf9af4f94b4832e8243190e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d11850f4ca4c5081ca9ab33923ea98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:47:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Creating image(s)
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "/opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "/opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "/opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:47:01 user nova-compute[75073]: INFO nova.compute.claims [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Claim successful on node user
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk 1073741824" returned: 0 in 0.145s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:47:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.policy [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df42cc15802446e4b2d30fa07867558a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065d5cca4023448b80179c4471dcb459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Cannot resize image /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Ensure instance console log exists: /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Successfully created port: 9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:47:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Creating image(s)
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "/opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "/opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk 1073741824" returned: 0 in 0.062s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Successfully created port: 3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Successfully updated port: 9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquired lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-changed-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Refreshing instance network info cache due to event network-changed-9faab649-a89b-43b6-ab93-d035407322e4. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] Acquiring lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Cannot resize image /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Ensure instance console log exists: /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Updating instance_info_cache with network_info: [{"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Releasing lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Instance network_info: |[{"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] Acquired lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Refreshing network info cache for port 9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Start _get_guest_xml network_info=[{"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:47:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1636877558',display_name='tempest-VolumesNegativeTest-instance-1636877558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1636877558',id=37,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d11850f4ca4c5081ca9ab33923ea98',ramdisk_id='',reservation_id='r-xd7vpf88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-37476045',owner_user_name='tempest-VolumesNegativeTest-37476045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:02Z,user_data=None,user_id='7052a6daf9af4f94b4832e8243190e53',uuid=13caeda1-a8f4-4714-91b2-5d91bb54ce07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converting VIF {"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.objects.instance [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lazy-loading 'pci_devices' on Instance uuid 13caeda1-a8f4-4714-91b2-5d91bb54ce07 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:47:03 user nova-compute[75073]:   <uuid>13caeda1-a8f4-4714-91b2-5d91bb54ce07</uuid>
Nov 24 10:47:03 user nova-compute[75073]:   <name>instance-00000025</name>
Nov 24 10:47:03 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:47:03 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:47:03 user nova-compute[75073]:   <metadata>
Nov 24 10:47:03 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:47:03 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:name>tempest-VolumesNegativeTest-instance-1636877558</nova:name>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:47:03</nova:creationTime>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:47:03 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:47:03 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:owner>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:user uuid="7052a6daf9af4f94b4832e8243190e53">tempest-VolumesNegativeTest-37476045-project-member</nova:user>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:project uuid="a6d11850f4ca4c5081ca9ab33923ea98">tempest-VolumesNegativeTest-37476045</nova:project>
Nov 24 10:47:03 user nova-compute[75073]:       </nova:owner>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:47:03 user nova-compute[75073]:       <nova:ports>
Nov 24 10:47:03 user nova-compute[75073]:         <nova:port uuid="9faab649-a89b-43b6-ab93-d035407322e4">
Nov 24 10:47:03 user nova-compute[75073]:           <nova:ip type="fixed" address="192.168.233.101" ipVersion="4"/>
Nov 24 10:47:03 user nova-compute[75073]:         </nova:port>
Nov 24 10:47:03 user nova-compute[75073]:       </nova:ports>
Nov 24 10:47:03 user nova-compute[75073]:     </nova:instance>
Nov 24 10:47:03 user nova-compute[75073]:   </metadata>
Nov 24 10:47:03 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:47:03 user nova-compute[75073]:     <system>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="serial">13caeda1-a8f4-4714-91b2-5d91bb54ce07</entry>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="uuid">13caeda1-a8f4-4714-91b2-5d91bb54ce07</entry>
Nov 24 10:47:03 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:47:03 user nova-compute[75073]:     </system>
Nov 24 10:47:03 user nova-compute[75073]:   </sysinfo>
Nov 24 10:47:03 user nova-compute[75073]:   <os>
Nov 24 10:47:03 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:47:03 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:47:03 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:47:03 user nova-compute[75073]:   </os>
Nov 24 10:47:03 user nova-compute[75073]:   <features>
Nov 24 10:47:03 user nova-compute[75073]:     <acpi/>
Nov 24 10:47:03 user nova-compute[75073]:     <apic/>
Nov 24 10:47:03 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:47:03 user nova-compute[75073]:   </features>
Nov 24 10:47:03 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:47:03 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:47:03 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:47:03 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:47:03 user nova-compute[75073]:   </clock>
Nov 24 10:47:03 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:47:03 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:47:03 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:47:03 user nova-compute[75073]:   </cpu>
Nov 24 10:47:03 user nova-compute[75073]:   <devices>
Nov 24 10:47:03 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:47:03 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:47:03 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk"/>
Nov 24 10:47:03 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:47:03 user nova-compute[75073]:     </disk>
Nov 24 10:47:03 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:47:03 user nova-compute[75073]:       <mac address="fa:16:3e:45:5a:eb"/>
Nov 24 10:47:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:03 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:47:03 user nova-compute[75073]:       <target dev="tap9faab649-a8"/>
Nov 24 10:47:03 user nova-compute[75073]:     </interface>
Nov 24 10:47:03 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:47:03 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/console.log" append="off"/>
Nov 24 10:47:03 user nova-compute[75073]:     </serial>
Nov 24 10:47:03 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:47:03 user nova-compute[75073]:     <video>
Nov 24 10:47:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:03 user nova-compute[75073]:     </video>
Nov 24 10:47:03 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:47:03 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:47:03 user nova-compute[75073]:     </rng>
Nov 24 10:47:03 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:47:03 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:47:03 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:47:03 user nova-compute[75073]:     </memballoon>
Nov 24 10:47:03 user nova-compute[75073]:   </devices>
Nov 24 10:47:03 user nova-compute[75073]: </domain>
Nov 24 10:47:03 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1636877558',display_name='tempest-VolumesNegativeTest-instance-1636877558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1636877558',id=37,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d11850f4ca4c5081ca9ab33923ea98',ramdisk_id='',reservation_id='r-xd7vpf88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-37476045',owner_user_name='tempest-VolumesNegativeTest-37476045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:02Z,user_data=None,user_id='7052a6daf9af4f94b4832e8243190e53',uuid=13caeda1-a8f4-4714-91b2-5d91bb54ce07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converting VIF {"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG os_vif [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42826512-60ac-56b8-8557-20c86f7a207f', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9faab649-a8, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9faab649-a8, col_values=(('qos', UUID('346253c0-9539-4eb7-9463-3251ae65d80a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9faab649-a8, col_values=(('external_ids', {'iface-id': '9faab649-a89b-43b6-ab93-d035407322e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:5a:eb', 'vm-uuid': '13caeda1-a8f4-4714-91b2-5d91bb54ce07'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:03 user nova-compute[75073]: INFO os_vif [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8')
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Successfully updated port: 3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquired lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] No VIF found with MAC fa:16:3e:45:5a:eb, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-changed-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Refreshing instance network info cache due to event network-changed-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] Acquiring lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Updated VIF entry in instance network info cache for port 9faab649-a89b-43b6-ab93-d035407322e4. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Updating instance_info_cache with network_info: [{"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7ecb4ba-e5e1-40e3-b9bc-e1ac615d688a req-dfc09da0-6581-409a-9136-b9f6a20f1620 service nova] Releasing lock "refresh_cache-13caeda1-a8f4-4714-91b2-5d91bb54ce07" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Updating instance_info_cache with network_info: [{"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Releasing lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Instance network_info: |[{"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] Acquired lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Refreshing network info cache for port 3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Start _get_guest_xml network_info=[{"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:47:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-335189813',display_name='tempest-VolumesActionsTest-instance-335189813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-335189813',id=38,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065d5cca4023448b80179c4471dcb459',ramdisk_id='',reservation_id='r-drrflgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1715840534',owner_user_name='tempest-VolumesActionsTest-1715840534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:02Z,user_data=None,user_id='df42cc15802446e4b2d30fa07867558a',uuid=f5737799-4130-4446-99b4-5d7fc7378d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converting VIF {"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lazy-loading 'pci_devices' on Instance uuid f5737799-4130-4446-99b4-5d7fc7378d77 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:47:04 user nova-compute[75073]:   <uuid>f5737799-4130-4446-99b4-5d7fc7378d77</uuid>
Nov 24 10:47:04 user nova-compute[75073]:   <name>instance-00000026</name>
Nov 24 10:47:04 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:47:04 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:47:04 user nova-compute[75073]:   <metadata>
Nov 24 10:47:04 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:47:04 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:name>tempest-VolumesActionsTest-instance-335189813</nova:name>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:47:04</nova:creationTime>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:47:04 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:47:04 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:owner>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:user uuid="df42cc15802446e4b2d30fa07867558a">tempest-VolumesActionsTest-1715840534-project-member</nova:user>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:project uuid="065d5cca4023448b80179c4471dcb459">tempest-VolumesActionsTest-1715840534</nova:project>
Nov 24 10:47:04 user nova-compute[75073]:       </nova:owner>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:47:04 user nova-compute[75073]:       <nova:ports>
Nov 24 10:47:04 user nova-compute[75073]:         <nova:port uuid="3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8">
Nov 24 10:47:04 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 10:47:04 user nova-compute[75073]:         </nova:port>
Nov 24 10:47:04 user nova-compute[75073]:       </nova:ports>
Nov 24 10:47:04 user nova-compute[75073]:     </nova:instance>
Nov 24 10:47:04 user nova-compute[75073]:   </metadata>
Nov 24 10:47:04 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:47:04 user nova-compute[75073]:     <system>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="serial">f5737799-4130-4446-99b4-5d7fc7378d77</entry>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="uuid">f5737799-4130-4446-99b4-5d7fc7378d77</entry>
Nov 24 10:47:04 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:47:04 user nova-compute[75073]:     </system>
Nov 24 10:47:04 user nova-compute[75073]:   </sysinfo>
Nov 24 10:47:04 user nova-compute[75073]:   <os>
Nov 24 10:47:04 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:47:04 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:47:04 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:47:04 user nova-compute[75073]:   </os>
Nov 24 10:47:04 user nova-compute[75073]:   <features>
Nov 24 10:47:04 user nova-compute[75073]:     <acpi/>
Nov 24 10:47:04 user nova-compute[75073]:     <apic/>
Nov 24 10:47:04 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:47:04 user nova-compute[75073]:   </features>
Nov 24 10:47:04 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:47:04 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:47:04 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:47:04 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:47:04 user nova-compute[75073]:   </clock>
Nov 24 10:47:04 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:47:04 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:47:04 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:47:04 user nova-compute[75073]:   </cpu>
Nov 24 10:47:04 user nova-compute[75073]:   <devices>
Nov 24 10:47:04 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:47:04 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:47:04 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk"/>
Nov 24 10:47:04 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:47:04 user nova-compute[75073]:     </disk>
Nov 24 10:47:04 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:47:04 user nova-compute[75073]:       <mac address="fa:16:3e:66:6b:f4"/>
Nov 24 10:47:04 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:04 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:47:04 user nova-compute[75073]:       <target dev="tap3044a9ec-ab"/>
Nov 24 10:47:04 user nova-compute[75073]:     </interface>
Nov 24 10:47:04 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:47:04 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/console.log" append="off"/>
Nov 24 10:47:04 user nova-compute[75073]:     </serial>
Nov 24 10:47:04 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:47:04 user nova-compute[75073]:     <video>
Nov 24 10:47:04 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:04 user nova-compute[75073]:     </video>
Nov 24 10:47:04 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:47:04 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:47:04 user nova-compute[75073]:     </rng>
Nov 24 10:47:04 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:47:04 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:47:04 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:47:04 user nova-compute[75073]:     </memballoon>
Nov 24 10:47:04 user nova-compute[75073]:   </devices>
Nov 24 10:47:04 user nova-compute[75073]: </domain>
Nov 24 10:47:04 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-335189813',display_name='tempest-VolumesActionsTest-instance-335189813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-335189813',id=38,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='065d5cca4023448b80179c4471dcb459',ramdisk_id='',reservation_id='r-drrflgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1715840534',owner_user_name='tempest-VolumesActionsTest-1715840534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:02Z,user_data=None,user_id='df42cc15802446e4b2d30fa07867558a',uuid=f5737799-4130-4446-99b4-5d7fc7378d77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converting VIF {"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG os_vif [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03bbd404-428a-5a8b-a31e-53800d3619ca', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3044a9ec-ab, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3044a9ec-ab, col_values=(('qos', UUID('e8f0a473-53fe-48d7-99d2-31f04d922fca')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3044a9ec-ab, col_values=(('external_ids', {'iface-id': '3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:6b:f4', 'vm-uuid': 'f5737799-4130-4446-99b4-5d7fc7378d77'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:04 user nova-compute[75073]: INFO os_vif [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab')
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] No VIF found with MAC fa:16:3e:66:6b:f4, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Updated VIF entry in instance network info cache for port 3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Updating instance_info_cache with network_info: [{"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-dd0c4d9d-c473-4518-8170-3a722a848098 req-49123e45-4df7-4449-a914-f24e2ed8c3bc service nova] Releasing lock "refresh_cache-f5737799-4130-4446-99b4-5d7fc7378d77" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:47:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] No waiting events found dispatching network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:06 user nova-compute[75073]: WARNING nova.compute.manager [req-755f0ec3-c163-4f8c-84a3-e61737b4ee90 req-9e97174a-3ddb-4f3c-a72c-fe25043360de service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received unexpected event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 for instance with vm_state building and task_state spawning.
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] No waiting events found dispatching network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:06 user nova-compute[75073]: WARNING nova.compute.manager [req-bef03bb5-7e7e-481b-a23a-db5397760d39 req-48aac2d4-9500-4aba-929d-2331a85222ca service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received unexpected event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 for instance with vm_state building and task_state spawning.
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] No waiting events found dispatching network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:08 user nova-compute[75073]: WARNING nova.compute.manager [req-7789509e-857d-473b-9cc5-5c64f79af83d req-93351530-8784-4305-a473-58934b1224b0 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received unexpected event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 for instance with vm_state building and task_state spawning.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] No waiting events found dispatching network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:08 user nova-compute[75073]: WARNING nova.compute.manager [req-76b9ab8a-d2a2-438b-9d3f-4013eac19c40 req-3613f2a5-754b-423f-8a4f-686f44c882f7 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received unexpected event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 for instance with vm_state building and task_state spawning.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Instance spawned successfully.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Instance spawned successfully.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Took 7.14 seconds to spawn the instance on the hypervisor.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.compute.manager [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Took 7.08 seconds to build instance.
Nov 24 10:47:08 user nova-compute[75073]: INFO nova.compute.manager [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Took 7.77 seconds to build instance.
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bfd83af0-4656-4882-958e-033be494277c tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.174s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-41552382-912e-4d9b-b6c2-db6ce7efa42d tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.877s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:47:09 user nova-compute[75073]: INFO nova.compute.claims [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Claim successful on node user
Nov 24 10:47:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:47:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.policy [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd71e749d8a944f9bda8a3a4675e21a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09653049e51e496c9f34f8d8fb8a707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:47:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Creating image(s)
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "/opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "/opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "/opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.207s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Successfully created port: efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk 1073741824" returned: 0 in 0.053s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Cannot resize image /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Ensure instance console log exists: /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Successfully updated port: efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquired lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-changed-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.compute.manager [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Refreshing instance network info cache due to event network-changed-efec831c-d98c-401a-ada1-8d01fa96c4c0. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] Acquiring lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:10 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.neutron [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Updating instance_info_cache with network_info: [{"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Releasing lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Instance network_info: |[{"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] Acquired lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.neutron [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Refreshing network info cache for port efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Start _get_guest_xml network_info=[{"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:47:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-582042262',display_name='tempest-VolumesActionsTest-instance-582042262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-582042262',id=39,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-v0r8zd2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:10Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lazy-loading 'pci_devices' on Instance uuid 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:47:11 user nova-compute[75073]:   <uuid>85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6</uuid>
Nov 24 10:47:11 user nova-compute[75073]:   <name>instance-00000027</name>
Nov 24 10:47:11 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:47:11 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:47:11 user nova-compute[75073]:   <metadata>
Nov 24 10:47:11 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:47:11 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:name>tempest-VolumesActionsTest-instance-582042262</nova:name>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:47:11</nova:creationTime>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:47:11 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:47:11 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:owner>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:user uuid="dd71e749d8a944f9bda8a3a4675e21a4">tempest-VolumesActionsTest-1874390497-project-member</nova:user>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:project uuid="09653049e51e496c9f34f8d8fb8a707f">tempest-VolumesActionsTest-1874390497</nova:project>
Nov 24 10:47:11 user nova-compute[75073]:       </nova:owner>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:47:11 user nova-compute[75073]:       <nova:ports>
Nov 24 10:47:11 user nova-compute[75073]:         <nova:port uuid="efec831c-d98c-401a-ada1-8d01fa96c4c0">
Nov 24 10:47:11 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 10:47:11 user nova-compute[75073]:         </nova:port>
Nov 24 10:47:11 user nova-compute[75073]:       </nova:ports>
Nov 24 10:47:11 user nova-compute[75073]:     </nova:instance>
Nov 24 10:47:11 user nova-compute[75073]:   </metadata>
Nov 24 10:47:11 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:47:11 user nova-compute[75073]:     <system>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="serial">85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6</entry>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="uuid">85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6</entry>
Nov 24 10:47:11 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:47:11 user nova-compute[75073]:     </system>
Nov 24 10:47:11 user nova-compute[75073]:   </sysinfo>
Nov 24 10:47:11 user nova-compute[75073]:   <os>
Nov 24 10:47:11 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:47:11 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:47:11 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:47:11 user nova-compute[75073]:   </os>
Nov 24 10:47:11 user nova-compute[75073]:   <features>
Nov 24 10:47:11 user nova-compute[75073]:     <acpi/>
Nov 24 10:47:11 user nova-compute[75073]:     <apic/>
Nov 24 10:47:11 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:47:11 user nova-compute[75073]:   </features>
Nov 24 10:47:11 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:47:11 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:47:11 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:47:11 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:47:11 user nova-compute[75073]:   </clock>
Nov 24 10:47:11 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:47:11 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:47:11 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:47:11 user nova-compute[75073]:   </cpu>
Nov 24 10:47:11 user nova-compute[75073]:   <devices>
Nov 24 10:47:11 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:47:11 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:47:11 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk"/>
Nov 24 10:47:11 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:47:11 user nova-compute[75073]:     </disk>
Nov 24 10:47:11 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:47:11 user nova-compute[75073]:       <mac address="fa:16:3e:9b:fc:74"/>
Nov 24 10:47:11 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:11 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:47:11 user nova-compute[75073]:       <target dev="tapefec831c-d9"/>
Nov 24 10:47:11 user nova-compute[75073]:     </interface>
Nov 24 10:47:11 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:47:11 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/console.log" append="off"/>
Nov 24 10:47:11 user nova-compute[75073]:     </serial>
Nov 24 10:47:11 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:47:11 user nova-compute[75073]:     <video>
Nov 24 10:47:11 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:11 user nova-compute[75073]:     </video>
Nov 24 10:47:11 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:47:11 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:47:11 user nova-compute[75073]:     </rng>
Nov 24 10:47:11 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:47:11 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:47:11 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:47:11 user nova-compute[75073]:     </memballoon>
Nov 24 10:47:11 user nova-compute[75073]:   </devices>
Nov 24 10:47:11 user nova-compute[75073]: </domain>
Nov 24 10:47:11 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-582042262',display_name='tempest-VolumesActionsTest-instance-582042262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-582042262',id=39,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-v0r8zd2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:10Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG os_vif [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af50b7e4-c3a4-502a-83f0-77f7d344711a', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefec831c-d9, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefec831c-d9, col_values=(('qos', UUID('46c47ee9-7b81-4af7-a881-115b20f656e9')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefec831c-d9, col_values=(('external_ids', {'iface-id': 'efec831c-d98c-401a-ada1-8d01fa96c4c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:fc:74', 'vm-uuid': '85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:11 user nova-compute[75073]: INFO os_vif [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9')
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:47:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] No VIF found with MAC fa:16:3e:9b:fc:74, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:47:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Updated VIF entry in instance network info cache for port efec831c-d98c-401a-ada1-8d01fa96c4c0. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:47:12 user nova-compute[75073]: DEBUG nova.network.neutron [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Updating instance_info_cache with network_info: [{"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-57bcd784-4b9b-4a8e-a73d-6a042b53982f req-91059abe-045f-4e2d-bdf1-b1ec5763b509 service nova] Releasing lock "refresh_cache-85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG nova.compute.manager [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] No waiting events found dispatching network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:13 user nova-compute[75073]: WARNING nova.compute.manager [req-8ea83a18-0258-4dc6-bcc3-238d610abb92 req-03bde8a0-47c5-402a-8820-dad286904a3f service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received unexpected event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 for instance with vm_state building and task_state spawning.
Nov 24 10:47:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] No waiting events found dispatching network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:15 user nova-compute[75073]: WARNING nova.compute.manager [req-2f892da4-9a15-4772-bb30-36ae519b380e req-620c1228-7b10-4920-89ee-40a461e7bc98 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received unexpected event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 for instance with vm_state building and task_state spawning.
Nov 24 10:47:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Instance spawned successfully.
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:47:15 user nova-compute[75073]: INFO nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 24 10:47:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:47:15 user nova-compute[75073]: INFO nova.compute.manager [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Took 6.59 seconds to build instance.
Nov 24 10:47:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7af557cf-a9d7-403c-9286-9018537f8111 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.683s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:47:49 user nova-compute[75073]: INFO nova.compute.claims [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Claim successful on node user
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:47:49 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.policy [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:47:49 user nova-compute[75073]: INFO nova.virt.block_device [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Booting with volume 18c9bf5a-e01a-483a-bc7b-1cc4c246649e at /dev/vda
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.utils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5ad53-5549-4a7c-8082-3dec76e41aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[04638022-9690-4318-b56c-29adb591bedd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f3d35-571e-47fa-9fb0-f5c826ebbcfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d01210-e5fd-45be-a41d-4310d9d09ede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:47:49 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:47:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba31961e-09d1-4530-aa41-f698dd700eac]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG os_brick.utils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:47:49 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating existing volume attachment record: c19b0bd6-d6e0-4239-bc2e-d2f61621b19d {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Successfully created port: 1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Successfully updated port: 1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing instance network info cache due to event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Instance network_info: |[{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updated VIF entry in instance network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fbd133fa-cf0f-41a2-89bc-d80bf284cd97 req-7f62b98a-ed20-4c1a-87f8-747332f3ef3a service nova] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:47:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing instance network info cache due to event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.network.neutron [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:47:55 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Creating image(s)
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Ensure instance console log exists: /opt/stack/data/nova/instances/ad5d4af5-6727-4e80-baef-a06224906f70/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Start _get_guest_xml network_info=[{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c19b0bd6-d6e0-4239-bc2e-d2f61621b19d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad5d4af5-6727-4e80-baef-a06224906f70', 'attached_at': '', 'detached_at': '', 'volume_id': '18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'serial': '18c9bf5a-e01a-483a-bc7b-1cc4c246649e'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:47:55 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:55 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:47:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:47:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:47:56 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updated VIF entry in instance network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfcac7f-cd9f-44a9-ac41-4e37f6490cea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62bb97a2-22bf-4532-bb10-6a069d610af9 req-7c4652dd-c43e-4c3f-9f7f-0e2483b3a7f8 service nova] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:47:56 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab22b5-42e5-4e0d-856b-29f0a9492769]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e] added
Nov 24 10:47:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940595b-44f6-4ee2-a300-e19c865cc81f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151fae1-f129-427c-a762-0d0d8637ed72]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjGhDinv {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XjGhDinv" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3861fbe8-5961-4358-985e-6875107576e7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XjGhDinv'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67be66b-2250-43d7-8917-0959019119bc]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca87e0d-b18a-4f55-9bdd-0d1144d020fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:47:56 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:47:56 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:47:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:47:56 user nova-compute[75073]: 
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b679bc4-d1fd-42b3-b4c6-c478cac363de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]
Nov 24 10:47:56 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.
Nov 24 10:47:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e22499-1942-40f9-aea5-1a76b89c5d2f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf94216-4d99-4397-9542-c47031d646cb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:47:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:47:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96b7a1-cad3-43ec-971e-87331de2999d]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:47:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8245MB free_disk=25.266387939453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c72a667c-efdb-46fa-b3dc-1a168caec542 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 13caeda1-a8f4-4714-91b2-5d91bb54ce07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance f5737799-4130-4446-99b4-5d7fc7378d77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ad5d4af5-6727-4e80-baef-a06224906f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23861383664346362', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861383664346362', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343020732',display_name='tempest-TestVolumeBootPattern-server-1343020732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343020732',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-p04qv1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:50Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=ad5d4af5-6727-4e80-baef-a06224906f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid ad5d4af5-6727-4e80-baef-a06224906f70 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:47:57 user nova-compute[75073]:   <uuid>ad5d4af5-6727-4e80-baef-a06224906f70</uuid>
Nov 24 10:47:57 user nova-compute[75073]:   <name>instance-00000028</name>
Nov 24 10:47:57 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:47:57 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:47:57 user nova-compute[75073]:   <metadata>
Nov 24 10:47:57 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:47:57 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:47:57 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-server-1343020732</nova:name>
Nov 24 10:47:57 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:47:55</nova:creationTime>
Nov 24 10:47:57 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:47:57 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:47:57 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:47:57 user nova-compute[75073]:       <nova:owner>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:47:57 user nova-compute[75073]:       </nova:owner>
Nov 24 10:47:57 user nova-compute[75073]:       <nova:ports>
Nov 24 10:47:57 user nova-compute[75073]:         <nova:port uuid="1727bd93-a1b0-4784-928c-20f8625e14a6">
Nov 24 10:47:57 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 10:47:57 user nova-compute[75073]:         </nova:port>
Nov 24 10:47:57 user nova-compute[75073]:       </nova:ports>
Nov 24 10:47:57 user nova-compute[75073]:     </nova:instance>
Nov 24 10:47:57 user nova-compute[75073]:   </metadata>
Nov 24 10:47:57 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:47:57 user nova-compute[75073]:     <system>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="serial">ad5d4af5-6727-4e80-baef-a06224906f70</entry>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="uuid">ad5d4af5-6727-4e80-baef-a06224906f70</entry>
Nov 24 10:47:57 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:47:57 user nova-compute[75073]:     </system>
Nov 24 10:47:57 user nova-compute[75073]:   </sysinfo>
Nov 24 10:47:57 user nova-compute[75073]:   <os>
Nov 24 10:47:57 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:47:57 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:47:57 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:47:57 user nova-compute[75073]:   </os>
Nov 24 10:47:57 user nova-compute[75073]:   <features>
Nov 24 10:47:57 user nova-compute[75073]:     <acpi/>
Nov 24 10:47:57 user nova-compute[75073]:     <apic/>
Nov 24 10:47:57 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:47:57 user nova-compute[75073]:   </features>
Nov 24 10:47:57 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:47:57 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:47:57 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:47:57 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:47:57 user nova-compute[75073]:   </clock>
Nov 24 10:47:57 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:47:57 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:47:57 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:47:57 user nova-compute[75073]:   </cpu>
Nov 24 10:47:57 user nova-compute[75073]:   <devices>
Nov 24 10:47:57 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:47:57 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:47:57 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 10:47:57 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:47:57 user nova-compute[75073]:       <serial>18c9bf5a-e01a-483a-bc7b-1cc4c246649e</serial>
Nov 24 10:47:57 user nova-compute[75073]:     </disk>
Nov 24 10:47:57 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:47:57 user nova-compute[75073]:       <mac address="fa:16:3e:45:7d:af"/>
Nov 24 10:47:57 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:57 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:47:57 user nova-compute[75073]:       <target dev="tap1727bd93-a1"/>
Nov 24 10:47:57 user nova-compute[75073]:     </interface>
Nov 24 10:47:57 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:47:57 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ad5d4af5-6727-4e80-baef-a06224906f70/console.log" append="off"/>
Nov 24 10:47:57 user nova-compute[75073]:     </serial>
Nov 24 10:47:57 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:47:57 user nova-compute[75073]:     <video>
Nov 24 10:47:57 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:47:57 user nova-compute[75073]:     </video>
Nov 24 10:47:57 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:47:57 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:47:57 user nova-compute[75073]:     </rng>
Nov 24 10:47:57 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:47:57 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:47:57 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:47:57 user nova-compute[75073]:     </memballoon>
Nov 24 10:47:57 user nova-compute[75073]:   </devices>
Nov 24 10:47:57 user nova-compute[75073]: </domain>
Nov 24 10:47:57 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343020732',display_name='tempest-TestVolumeBootPattern-server-1343020732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343020732',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-p04qv1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:47:50Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=ad5d4af5-6727-4e80-baef-a06224906f70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG os_vif [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bee896d-b684-5440-8bd3-365701791d3d', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1727bd93-a1, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1727bd93-a1, col_values=(('qos', UUID('fab289b0-4639-4cda-9473-e6ebb891b4ac')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1727bd93-a1, col_values=(('external_ids', {'iface-id': '1727bd93-a1b0-4784-928c-20f8625e14a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:7d:af', 'vm-uuid': 'ad5d4af5-6727-4e80-baef-a06224906f70'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:57 user nova-compute[75073]: INFO os_vif [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1')
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:45:7d:af, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:47:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] No waiting events found dispatching network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:47:59 user nova-compute[75073]: WARNING nova.compute.manager [req-1daf60b5-190e-4b12-bea2-cd41732422ad req-1d9e10f5-1b2c-434e-8df9-7c4f788e04ca service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received unexpected event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 for instance with vm_state building and task_state spawning.
Nov 24 10:47:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:47:59 user nova-compute[75073]: INFO nova.compute.manager [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Shelving
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:47:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance destroyed successfully.
Nov 24 10:47:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Beginning cold snapshot process
Nov 24 10:48:00 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:48:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk /opt/stack/data/nova/instances/snapshots/tmp_c36aqh3/5ade22d51195451e9004b81829219b05 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk /opt/stack/data/nova/instances/snapshots/tmp_c36aqh3/5ade22d51195451e9004b81829219b05" returned: 0 in 0.850s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Snapshot extracted, beginning image upload
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:48:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Instance spawned successfully.
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] No waiting events found dispatching network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:01 user nova-compute[75073]: WARNING nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received unexpected event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 for instance with vm_state building and task_state spawning.
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:01 user nova-compute[75073]: WARNING nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state active and task_state shelving_image_uploading.
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:01 user nova-compute[75073]: WARNING nova.compute.manager [req-a4da500a-2272-41d7-bac6-a66acf84c065 req-7e484450-809b-4317-8889-3483ec74e68f service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state active and task_state shelving_image_uploading.
Nov 24 10:48:01 user nova-compute[75073]: INFO nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:48:01 user nova-compute[75073]: INFO nova.compute.manager [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Took 12.23 seconds to build instance.
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c3cca1a4-709c-4c84-b0c6-8bac7ad031ff tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 13caeda1-a8f4-4714-91b2-5d91bb54ce07 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid f5737799-4130-4446-99b4-5d7fc7378d77 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid ad5d4af5-6727-4e80-baef-a06224906f70 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:48:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:48:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Snapshot image upload complete
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:48:03 user nova-compute[75073]: INFO nova.compute.manager [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Shelve offloading
Nov 24 10:48:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance destroyed successfully.
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance destroyed successfully.
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'resources' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMqLy/3vopOEWpNCQB/yRTgw2DZ7E5aiOMVVK3a51LaH/n6ltd3dFS2XB4DuYo7c1V5vhomJlFhwRStmQitredXlT+ptcMrRm59m31Ew6R3H9lT3x741GYYG15OE7eYw==',key_name='tempest-keypair-433871786',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:48:03.496967',shelved_host='user',shelved_image_id='e843e40c-905b-4311-a225-539bcc1d53df'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG os_vif [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbd06bda-80, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7ed02b3-9228-44c1-9050-66e6bcab9db9) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:04 user nova-compute[75073]: INFO os_vif [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80')
Nov 24 10:48:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Deleting instance files /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542_del
Nov 24 10:48:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Deletion of /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542_del complete
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing instance network info cache due to event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:48:04 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Deleted allocations for instance c72a667c-efdb-46fa-b3dc-1a168caec542
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.objects.instance [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'numa_topology' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.objects.base [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<c72a667c-efdb-46fa-b3dc-1a168caec542> lazy-loaded attributes: resources,numa_topology {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updated VIF entry in instance network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbbd06bda-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1151197b-6189-48c5-a1a6-645ec5d0d9c8 req-38e9df15-28d9-4280-9e0a-062a37b49e3d service nova] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-811ead8e-5fae-48bc-976c-b72c628df018 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.678s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.116s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:04 user nova-compute[75073]: INFO nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] During sync_power_state the instance has a pending task (shelving_image_uploading). Skip.
Nov 24 10:48:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-changed-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Refreshing instance network info cache due to event network-changed-1f8e74d4-bda7-4851-b4f7-472ed36e5950. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] Acquiring lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] Acquired lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Refreshing network info cache for port 1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updated VIF entry in instance network info cache for port 1f8e74d4-bda7-4851-b4f7-472ed36e5950. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating instance_info_cache with network_info: [{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99b52357-3c6a-4390-a075-fd57eee856dc req-6388e4c9-5227-4311-a72d-2926904b1b12 service nova] Releasing lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:48:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:10 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:11 user nova-compute[75073]: INFO nova.compute.manager [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attaching volume d52417ae-2102-4db7-9d4f-e1f799e7fa0b to /dev/vdb
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.utils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b05fbdf-b695-4371-bf14-888c2c72b9cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[647affc3-a2d1-4b97-8aed-718697a3c105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f430fd2c-45d9-4c8f-bfd2-25df346c42ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd50a728-fd42-4b60-848a-4a53db3cc30e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:48:11 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:48:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2564f-38c1-4c05-a5f9-61f4a599365b]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG os_brick.utils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:48:11 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating existing volume attachment record: 0e1f27b9-3173-4722-bc13-e24149101712 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:48:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJcjRuXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:48:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:48:17 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:48:17 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8dfaee-a1a9-42ef-9c2f-ff231f003384]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:48:17 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb48e52c-8e64-4f72-bc2b-78c8a30a284f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b] added
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b4d88d-505c-4ce4-a977-f673450a6bc2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b75a5b-8bc3-41e9-8943-dacf6a6d82c7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJcjRuXO {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJcjRuXO" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fa4e9-f8ba-4f68-9ab2-db3996b54ae3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJcjRuXO'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[05544d82-3e0f-4b2a-91eb-41f055ab182a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0db63-0c68-4c89-9113-7468f0209c9a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62de6ad-8786-4c4b-a426-cebb462546cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260]
Nov 24 10:48:17 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260] successful.
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95d5af-4e5b-4924-9c7d-bb51d5170b92]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2acfe-1d73-4fb6-9e7b-9365d8ebed02]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:17 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:17 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:17 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9216f6-72b0-4498-bd50-71ba1fb92a09]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:17 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJcjRuXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23962303034393133', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962303034393133', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:48:18 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:18 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:48:18 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:48:18 user nova-compute[75073]:   <serial>d52417ae-2102-4db7-9d4f-e1f799e7fa0b</serial>
Nov 24 10:48:18 user nova-compute[75073]: </disk>
Nov 24 10:48:18 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:48:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:48:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:48:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No VIF found with MAC fa:16:3e:9f:c5:86, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:48:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e5341229-0267-4290-97ec-703f04e72e78 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.186s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:22 user nova-compute[75073]: INFO nova.compute.manager [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attaching volume 338477e6-98cf-46db-91c5-b7f43997cdc0 to /dev/vdc
Nov 24 10:48:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.utils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a51d9-afc0-47b0-bb69-17ac67e05f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9a5a6-59f0-4f89-a8c8-7b6d55a56514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3226bb5-f648-4c22-b83f-d7728e9ef18a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334a212-b88d-4431-94a3-d4af7ead6605]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:48:22 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:48:22 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e587e4-4310-4bb2-b7e9-cd68a4aef5eb]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG os_brick.utils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:48:22 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating existing volume attachment record: b61b5a6c-4fdd-4f25-a3cf-a8d643b921f3 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:48:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlUMixCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:48:28 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:48:28 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:48:28 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79789f9-7722-4627-aa98-4d3353d65eab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:48:28 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c395d-023e-403a-85da-4456df6b401c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0] added
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba5ead-f38c-4172-b93e-70fd035c5a66]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3f5fc-6792-42ee-bc8a-afe8162b9434]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlUMixCt {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlUMixCt" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efe980-6b52-4849-b755-32809c3e3c23]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wlUMixCt'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[87599031-b366-4242-9690-5fce9b256793]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8d820-f396-4b9c-a98d-13f52b69e7dd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fd9af4-4eec-4470-b2af-c627f1a6f94c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260]
Nov 24 10:48:28 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260] successful.
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2669db94-801d-48a3-b654-f5cea8af466a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e44ed-48b1-4cf0-b0b4-eed1f337b841]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:28 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:48:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:48:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c95d83-0544-404f-9c60-7c575d675ab0]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlUMixCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:48:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26165376638643864', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165376638643864', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:48:30 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:30 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:48:30 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:48:30 user nova-compute[75073]:   <serial>338477e6-98cf-46db-91c5-b7f43997cdc0</serial>
Nov 24 10:48:30 user nova-compute[75073]: </disk>
Nov 24 10:48:30 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] No VIF found with MAC fa:16:3e:9f:c5:86, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:48:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6c0e930-a410-4d24-9d59-dc2eb8e2eda4 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.065s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:31 user nova-compute[75073]: INFO nova.compute.manager [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Detaching volume d52417ae-2102-4db7-9d4f-e1f799e7fa0b
Nov 24 10:48:31 user nova-compute[75073]: INFO nova.virt.block_device [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attempting to driver detach volume d52417ae-2102-4db7-9d4f-e1f799e7fa0b from mountpoint /dev/vdb
Nov 24 10:48:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Attempting to detach device vdb from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:48:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:48:31 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:31 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:48:31 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:48:31 user nova-compute[75073]:   <serial>d52417ae-2102-4db7-9d4f-e1f799e7fa0b</serial>
Nov 24 10:48:31 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:48:31 user nova-compute[75073]: </disk>
Nov 24 10:48:31 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:48:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdb from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the persistent domain config.
Nov 24 10:48:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:48:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:48:31 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:31 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:48:31 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:48:31 user nova-compute[75073]:   <serial>d52417ae-2102-4db7-9d4f-e1f799e7fa0b</serial>
Nov 24 10:48:31 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:48:31 user nova-compute[75073]: </disk>
Nov 24 10:48:31 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:48:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:48:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:48:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:51 user nova-compute[75073]: INFO nova.compute.manager [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Terminating instance
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-unplugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] No waiting events found dispatching network-vif-unplugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [req-38b71ad5-cce6-4c56-9be1-e5c15009ec73 req-ae15e5c8-ae3c-41a5-b7c0-3249f14c4780 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-unplugged-9faab649-a89b-43b6-ab93-d035407322e4 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Instance destroyed successfully.
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lazy-loading 'resources' on Instance uuid 13caeda1-a8f4-4714-91b2-5d91bb54ce07 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1636877558',display_name='tempest-VolumesNegativeTest-instance-1636877558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1636877558',id=37,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d11850f4ca4c5081ca9ab33923ea98',ramdisk_id='',reservation_id='r-xd7vpf88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-37476045',owner_user_name='tempest-VolumesNegativeTest-37476045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:47:09Z,user_data=None,user_id='7052a6daf9af4f94b4832e8243190e53',uuid=13caeda1-a8f4-4714-91b2-5d91bb54ce07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converting VIF {"id": "9faab649-a89b-43b6-ab93-d035407322e4", "address": "fa:16:3e:45:5a:eb", "network": {"id": "9ba5c768-a2c6-4a84-9def-3528240aebb8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1ffe23cbf8274b22b6c1d014d3fd0643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9faab649-a8", "ovs_interfaceid": "9faab649-a89b-43b6-ab93-d035407322e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG os_vif [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9faab649-a8, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=346253c0-9539-4eb7-9463-3251ae65d80a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:51 user nova-compute[75073]: INFO os_vif [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5a:eb,bridge_name='br-int',has_traffic_filtering=True,id=9faab649-a89b-43b6-ab93-d035407322e4,network=Network(9ba5c768-a2c6-4a84-9def-3528240aebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9faab649-a8')
Nov 24 10:48:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Deleting instance files /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07_del
Nov 24 10:48:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Deletion of /opt/stack/data/nova/instances/13caeda1-a8f4-4714-91b2-5d91bb54ce07_del complete
Nov 24 10:48:51 user nova-compute[75073]: INFO nova.compute.manager [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 24 10:48:51 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:48:51 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:48:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b is timed out.
Nov 24 10:48:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdb from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the live domain config.
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJcjRuXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:48:52 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f236b9ce-e8d9-436e-b491-89bfe8168520]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:48:52 user nova-compute[75073]: No targets found.
Nov 24 10:48:52 user nova-compute[75073]: iSNS:
Nov 24 10:48:52 user nova-compute[75073]: No targets found.
Nov 24 10:48:52 user nova-compute[75073]: STATIC:
Nov 24 10:48:52 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b
Nov 24 10:48:52 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:48:52 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:48:52 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0
Nov 24 10:48:52 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:48:52 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:48:52 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e
Nov 24 10:48:52 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:48:52 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:48:52 user nova-compute[75073]: FIRMWARE:
Nov 24 10:48:52 user nova-compute[75073]: No targets found.
Nov 24 10:48:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:48:52 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:48:52 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff600ffb-3bca-4737-8887-7f7fa7f2c7d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[df721007-1285-47a1-a015-2504153f593f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:52 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:52 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:48:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:48:52 user nova-compute[75073]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b (non-flash)
Nov 24 10:48:52 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:48:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23847a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad89f8-fd6c-4a5e-86b6-f3105bb371a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fdef1a-46a6-4354-9309-6ef2873336d7]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c29b2-63db-46bf-8208-3b49b9de756c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb8d2f-4a71-4e36-bcd1-c1a1b7c35301]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aa32d7-374e-4351-ade7-8eb325cab900]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:52 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Took 0.44 seconds to deallocate network for instance.
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-c4669cba-4a46-42c5-9df4-4813e4f22890 req-157fb6dc-ad48-47bd-a406-0712fbe3b069 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-deleted-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2707db-3727-4adf-b99a-f4247a675c10]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260]
Nov 24 10:48:52 user nova-compute[75073]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b, portal: 172.16.0.220,3260] successful.
Nov 24 10:48:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d52417ae-2102-4db7-9d4f-e1f799e7fa0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5e2787-4faf-4d14-b11e-83c8cfbc0c2d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== disconnect_volume: return (321ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:52 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Deleted allocations for instance 13caeda1-a8f4-4714-91b2-5d91bb54ce07
Nov 24 10:48:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7874d83e-667d-48ed-8658-2f3855af9cb1 tempest-VolumesNegativeTest-37476045 tempest-VolumesNegativeTest-37476045-project-member] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-02bb8955-e105-4f8b-a4d1-4d009b9f563d tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] Acquiring lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] Lock "13caeda1-a8f4-4714-91b2-5d91bb54ce07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] No waiting events found dispatching network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:53 user nova-compute[75073]: WARNING nova.compute.manager [req-537a16e6-5959-4e18-9c39-167faab0e305 req-ee7df6cc-804b-4195-b9c5-6c9119265dc2 service nova] [instance: 13caeda1-a8f4-4714-91b2-5d91bb54ce07] Received unexpected event network-vif-plugged-9faab649-a89b-43b6-ab93-d035407322e4 for instance with vm_state deleted and task_state None.
Nov 24 10:48:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:54 user nova-compute[75073]: INFO nova.compute.manager [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Detaching volume 338477e6-98cf-46db-91c5-b7f43997cdc0
Nov 24 10:48:54 user nova-compute[75073]: INFO nova.virt.block_device [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Attempting to driver detach volume 338477e6-98cf-46db-91c5-b7f43997cdc0 from mountpoint /dev/vdc
Nov 24 10:48:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Attempting to detach device vdc from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:48:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:48:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:54 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:48:54 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:48:54 user nova-compute[75073]:   <serial>338477e6-98cf-46db-91c5-b7f43997cdc0</serial>
Nov 24 10:48:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:48:54 user nova-compute[75073]: </disk>
Nov 24 10:48:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:48:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdc from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the persistent domain config.
Nov 24 10:48:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:48:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:48:54 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:48:54 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:48:54 user nova-compute[75073]:   <target dev="vdc" bus="virtio"/>
Nov 24 10:48:54 user nova-compute[75073]:   <serial>338477e6-98cf-46db-91c5-b7f43997cdc0</serial>
Nov 24 10:48:54 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 10:48:54 user nova-compute[75073]: </disk>
Nov 24 10:48:54 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:48:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:48:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:48:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:48:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:48:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=25.270286560058594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance f5737799-4130-4446-99b4-5d7fc7378d77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ad5d4af5-6727-4e80-baef-a06224906f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:48:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:58 user nova-compute[75073]: INFO nova.compute.manager [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Terminating instance
Nov 24 10:48:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-unplugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] No waiting events found dispatching network-vif-unplugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-3200c311-67fe-4939-aa80-56d46b225053 req-7c33441e-671e-4663-ac4c-15b9ee8238c1 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-unplugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Instance destroyed successfully.
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lazy-loading 'resources' on Instance uuid f5737799-4130-4446-99b4-5d7fc7378d77 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-335189813',display_name='tempest-VolumesActionsTest-instance-335189813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-335189813',id=38,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='065d5cca4023448b80179c4471dcb459',ramdisk_id='',reservation_id='r-drrflgs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1715840534',owner_user_name='tempest-VolumesActionsTest-1715840534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:47:09Z,user_data=None,user_id='df42cc15802446e4b2d30fa07867558a',uuid=f5737799-4130-4446-99b4-5d7fc7378d77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converting VIF {"id": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "address": "fa:16:3e:66:6b:f4", "network": {"id": "947bac53-6d3c-451e-8e05-88b7da78d333", "bridge": "br-int", "label": "tempest-VolumesActionsTest-512478188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "065d5cca4023448b80179c4471dcb459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3044a9ec-ab", "ovs_interfaceid": "3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG os_vif [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3044a9ec-ab, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8f0a473-53fe-48d7-99d2-31f04d922fca) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:48:59 user nova-compute[75073]: INFO os_vif [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8,network=Network(947bac53-6d3c-451e-8e05-88b7da78d333),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3044a9ec-ab')
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Deleting instance files /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77_del
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Deletion of /opt/stack/data/nova/instances/f5737799-4130-4446-99b4-5d7fc7378d77_del complete
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.compute.manager [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Took 0.49 seconds to deallocate network for instance.
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:48:59 user nova-compute[75073]: INFO nova.compute.manager [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Terminating instance
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:48:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:00 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Deleted allocations for instance f5737799-4130-4446-99b4-5d7fc7378d77
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-unplugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] No waiting events found dispatching network-vif-unplugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-753b1f0c-1882-4dd5-8a86-b2ad480d1d1b req-6ad00189-0a16-4fed-8ab7-7a48624d2606 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-unplugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fbce6f36-1f8d-4dda-86c2-817fb87e50fa tempest-VolumesActionsTest-1715840534 tempest-VolumesActionsTest-1715840534-project-member] Lock "f5737799-4130-4446-99b4-5d7fc7378d77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Instance destroyed successfully.
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.objects.instance [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lazy-loading 'resources' on Instance uuid 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-582042262',display_name='tempest-VolumesActionsTest-instance-582042262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-582042262',id=39,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:47:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09653049e51e496c9f34f8d8fb8a707f',ramdisk_id='',reservation_id='r-v0r8zd2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1874390497',owner_user_name='tempest-VolumesActionsTest-1874390497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:47:16Z,user_data=None,user_id='dd71e749d8a944f9bda8a3a4675e21a4',uuid=85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converting VIF {"id": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "address": "fa:16:3e:9b:fc:74", "network": {"id": "fdb6a794-6da0-489a-b73e-deebaf5940e7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419645019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09653049e51e496c9f34f8d8fb8a707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec831c-d9", "ovs_interfaceid": "efec831c-d98c-401a-ada1-8d01fa96c4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG os_vif [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefec831c-d9, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46c47ee9-7b81-4af7-a881-115b20f656e9) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:00 user nova-compute[75073]: INFO os_vif [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:fc:74,bridge_name='br-int',has_traffic_filtering=True,id=efec831c-d98c-401a-ada1-8d01fa96c4c0,network=Network(fdb6a794-6da0-489a-b73e-deebaf5940e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec831c-d9')
Nov 24 10:49:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Deleting instance files /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6_del
Nov 24 10:49:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Deletion of /opt/stack/data/nova/instances/85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6_del complete
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] Acquiring lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] Lock "f5737799-4130-4446-99b4-5d7fc7378d77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] No waiting events found dispatching network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:49:00 user nova-compute[75073]: WARNING nova.compute.manager [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received unexpected event network-vif-plugged-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 for instance with vm_state deleted and task_state None.
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-b37db35a-1cf2-49dc-b632-4e237114c7d4 req-e55188e3-5239-4db9-ba99-e8a59ce21c05 service nova] [instance: f5737799-4130-4446-99b4-5d7fc7378d77] Received event network-vif-deleted-3044a9ec-ab9d-460f-9f1b-f89e5cd41ea8 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:00 user nova-compute[75073]: INFO nova.compute.manager [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 24 10:49:00 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:49:00 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:49:01 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:01 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Took 0.44 seconds to deallocate network for instance.
Nov 24 10:49:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:49:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:01 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Deleted allocations for instance 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6
Nov 24 10:49:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-17f9a1d8-a5b8-4dcb-b6be-ec65747e1259 tempest-VolumesActionsTest-1874390497 tempest-VolumesActionsTest-1874390497-project-member] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.648s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] Acquiring lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] Lock "85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] No waiting events found dispatching network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:49:02 user nova-compute[75073]: WARNING nova.compute.manager [req-9fa3112f-350a-436c-8afd-0d4dd4546db6 req-b0aea2cf-28df-4f9f-a078-0a7740e74827 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received unexpected event network-vif-plugged-efec831c-d98c-401a-ada1-8d01fa96c4c0 for instance with vm_state deleted and task_state None.
Nov 24 10:49:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-45511e7f-8b10-4ca8-879a-ef7bd5fe6529 req-e6898577-575c-48a4-adbc-f8f14a2cbe64 service nova] [instance: 85cb75b1-eb7f-4f66-9bf6-d2e6141ec3b6] Received event network-vif-deleted-efec831c-d98c-401a-ada1-8d01fa96c4c0 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:49:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating instance_info_cache with network_info: [{"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:49:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b is timed out.
Nov 24 10:49:14 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully detached device vdc from instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b from the live domain config.
Nov 24 10:49:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlUMixCt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:49:14 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc87d0-fb53-43b0-832f-092e23464072]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:49:14 user nova-compute[75073]: No targets found.
Nov 24 10:49:14 user nova-compute[75073]: iSNS:
Nov 24 10:49:14 user nova-compute[75073]: No targets found.
Nov 24 10:49:14 user nova-compute[75073]: STATIC:
Nov 24 10:49:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0
Nov 24 10:49:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:49:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:49:14 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e
Nov 24 10:49:14 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:49:14 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:49:14 user nova-compute[75073]: FIRMWARE:
Nov 24 10:49:14 user nova-compute[75073]: No targets found.
Nov 24 10:49:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:49:14 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:49:14 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19fc6d0-fb93-4589-a380-5c6fb2e8ef7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894e8d9-3d8e-44d4-b5a3-e746bdbeff27]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:14 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:49:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:14 user nova-compute[75073]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 (non-flash)
Nov 24 10:49:14 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238219f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0'): ({'sdd'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Removing single pathed devices sdd {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da0f35b-c10f-4df5-b908-227e7a16014b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[785cd3df-5bb4-4101-b9c6-40c931572033]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Flushing IO for device /dev/sdd {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[66821880-6b6c-4975-b63c-d15790ed5acf]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[945785c2-a173-4704-887a-54908afa9298]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4c3ef1-f846-4176-aef4-cc697055d1c3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e527c094-4715-40ff-9992-df6de67af692]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260]
Nov 24 10:49:15 user nova-compute[75073]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0, portal: 172.16.0.220,3260] successful.
Nov 24 10:49:15 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:338477e6-98cf-46db-91c5-b7f43997cdc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338043a-e449-43f7-adef-284277eb1006]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] <== disconnect_volume: return (311ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG nova.objects.instance [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'flavor' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-78f0b80b-15a5-4aac-824a-c043063e4a92 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:17 user nova-compute[75073]: INFO nova.compute.manager [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Terminating instance
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-unplugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] No waiting events found dispatching network-vif-unplugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-b811caca-63c2-43b6-9793-b1ced33d420a req-7cc2d68a-ea26-4771-8574-fd6020b4425f service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-unplugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:49:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Instance destroyed successfully.
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.objects.instance [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lazy-loading 'resources' on Instance uuid a9b8cc9d-0b5b-468b-ad86-fda2da4a253b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:46:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-302995548',display_name='tempest-AttachVolumeTestJSON-server-302995548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-302995548',id=36,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlRdKkkmNHexFl0IMOKw4yUhWu1vm2U4qZZZ4p6J/BSEy6utm6Tq9nGiCCtM6EO7ErWuTKt0xR3tFNMcejpSa9pwMCIWqF7ksSRhy7k2veaIGWyaLcnDdhGKF4znUa49Q==',key_name='tempest-keypair-251586635',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='800195c134fc45b892777e8d8e1cb13e',ramdisk_id='',reservation_id='r-qc0ltqsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-729242413',owner_user_name='tempest-AttachVolumeTestJSON-729242413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='288a86b67b4f449faffbbfe208a2effe',uuid=a9b8cc9d-0b5b-468b-ad86-fda2da4a253b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converting VIF {"id": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "address": "fa:16:3e:9f:c5:86", "network": {"id": "f0d82533-13bd-47a3-970d-ab3bae4adaba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-507175671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "800195c134fc45b892777e8d8e1cb13e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e74d4-bd", "ovs_interfaceid": "1f8e74d4-bda7-4851-b4f7-472ed36e5950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG os_vif [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f8e74d4-bd, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6327a08-2c15-47e2-abd3-2c34f3bd5d51) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:17 user nova-compute[75073]: INFO os_vif [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:c5:86,bridge_name='br-int',has_traffic_filtering=True,id=1f8e74d4-bda7-4851-b4f7-472ed36e5950,network=Network(f0d82533-13bd-47a3-970d-ab3bae4adaba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e74d4-bd')
Nov 24 10:49:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Deleting instance files /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b_del
Nov 24 10:49:17 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Deletion of /opt/stack/data/nova/instances/a9b8cc9d-0b5b-468b-ad86-fda2da4a253b_del complete
Nov 24 10:49:17 user nova-compute[75073]: INFO nova.compute.manager [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 24 10:49:17 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:49:17 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:18 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Took 0.74 seconds to deallocate network for instance.
Nov 24 10:49:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-321e42fe-83cb-4d10-b35f-150ad1b1bffe req-ce300082-f9db-4a01-8ac0-04ff66d70bb1 service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-deleted-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:18 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Deleted allocations for instance a9b8cc9d-0b5b-468b-ad86-fda2da4a253b
Nov 24 10:49:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-da27a0ea-f91a-44b4-b8b8-92128bc3a897 tempest-AttachVolumeTestJSON-729242413 tempest-AttachVolumeTestJSON-729242413-project-member] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.875s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] Acquiring lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] Lock "a9b8cc9d-0b5b-468b-ad86-fda2da4a253b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] No waiting events found dispatching network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:49:19 user nova-compute[75073]: WARNING nova.compute.manager [req-69d0f5a3-78a5-44a3-904a-0a272f8b9b20 req-a5bc3f8f-683a-4388-97da-7dc766f3a0ab service nova] [instance: a9b8cc9d-0b5b-468b-ad86-fda2da4a253b] Received unexpected event network-vif-plugged-1f8e74d4-bda7-4851-b4f7-472ed36e5950 for instance with vm_state deleted and task_state None.
Nov 24 10:49:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing instance network info cache due to event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:49:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:49:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updated VIF entry in instance network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:49:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-de0f52f7-65dc-40cb-82d0-613ab5bd3392 req-3c017ad5-5a4c-47ed-80a6-963a477f8421 service nova] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:49:48 user nova-compute[75073]: INFO nova.compute.claims [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Claim successful on node user
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:49:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:49:48 user nova-compute[75073]: INFO nova.virt.block_device [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Booting with volume 6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 at /dev/vda
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.policy [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8baa21b464846dcb42dd244e4434e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60805f65e934beb8c272dfb1f74b042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.utils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819c0b6-151a-4434-a93b-56b44344bef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b48de-6a9f-4aa0-acf8-52a8053618e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9627f954-d1aa-4bc9-9d65-af02ba6b62cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fc9fc-17b4-4de7-bed5-22cacfa400ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:49:48 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:49:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e64441-dbd7-4b5b-a0c4-7e6f671a10ed]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG os_brick.utils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:49:48 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating existing volume attachment record: f14f46d8-9909-47fe-9a91-28dc5ce3b5dc {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:49:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Successfully created port: 0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Successfully updated port: 0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquired lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing instance network info cache due to event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] Acquiring lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating instance_info_cache with network_info: [{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Releasing lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Instance network_info: |[{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] Acquired lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:49:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updated VIF entry in instance network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:49:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating instance_info_cache with network_info: [{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c7696b6f-e3e3-4bc5-83c1-299096ddc2f4 req-bd370a49-87a9-44c2-86cc-c319f1b202cd service nova] Releasing lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:52 user nova-compute[75073]: INFO nova.compute.manager [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Unshelving
Nov 24 10:49:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_requests' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'numa_topology' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:49:52 user nova-compute[75073]: INFO nova.compute.claims [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Claim successful on node user
Nov 24 10:49:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:52 user nova-compute[75073]: INFO nova.network.neutron [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating port bbd06bda-805c-45a9-9521-d506d6923e28 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.compute.manager [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing instance network info cache due to event network-changed-bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] Acquiring lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.network.neutron [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:49:53 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Creating image(s)
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'trusted_certs' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] Acquired lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:49:53 user nova-compute[75073]: DEBUG nova.network.neutron [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Refreshing network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:49:54 user nova-compute[75073]: DEBUG nova.objects.base [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<c72a667c-efdb-46fa-b3dc-1a168caec542> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:49:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:55 user nova-compute[75073]: DEBUG nova.virt.images [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] e843e40c-905b-4311-a225-539bcc1d53df was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:49:55 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:49:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.part /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.part /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.converted" returned: 0 in 0.501s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updated VIF entry in instance network info cache for port bbd06bda-805c-45a9-9521-d506d6923e28. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.network.neutron [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-92209a1a-d1ee-41e8-81f7-2cc779e46256 req-c2b95294-19fd-4f31-b5a2-ff773fa17974 service nova] Releasing lock "refresh_cache-c72a667c-efdb-46fa-b3dc-1a168caec542" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.230s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128,backing_fmt=raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:49:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Creating image(s)
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Did not create local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/4141e6d3-176d-4736-a836-373cd04d5f6d/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Start _get_guest_xml network_info=[{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'f14f46d8-9909-47fe-9a91-28dc5ce3b5dc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzXQJaws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4141e6d3-176d-4736-a836-373cd04d5f6d', 'attached_at': '', 'detached_at': '', 'volume_id': '6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 'serial': '6c629be9-66aa-4e9a-8f4b-54ceef1eddb2'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128,backing_fmt=raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk 1073741824" returned: 0 in 0.059s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c7cb7c6189fdf4ebbe344eb5704b9e071c06e128" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:56 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzXQJaws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:49:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:49:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:49:56 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb85fafd-c0cc-4fe9-b3e1-21d2f0c5518f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:49:56 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0354a0fa-a4d2-4f60-aa3d-de442fbae746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2] added
Nov 24 10:49:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470cd26-7a41-427d-b71b-3e9235931201]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'migration_context' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.objects.base [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<c72a667c-efdb-46fa-b3dc-1a168caec542> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:49:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Rebasing disk image.
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[10407792-0cc3-4af1-84d7-ee60d336477c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzXQJaws {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzXQJaws" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf70c41-9946-4cc7-a1b8-bfc851fafd30]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qzXQJaws'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa99e496-1265-45c5-895d-6563b41b05ac]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.427s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b -F raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[513df5e9-8f1b-4eda-be39-abbd7bb2cbbd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.24871826171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[46568d61-f434-4f23-9633-26bc474df871]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260]
Nov 24 10:49:57 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260] successful.
Nov 24 10:49:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271d8d0-43ac-4415-94a6-6aea8c8cfd66]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ad5d4af5-6727-4e80-baef-a06224906f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 4141e6d3-176d-4736-a836-373cd04d5f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (b8421a5b-83de-4630-bf28-983e95daab87): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3fbbf-6ea1-4b79-bdf7-817883019a61]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:57 user nova-compute[75073]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)
Nov 24 10:49:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:49:57 user nova-compute[75073]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)
Nov 24 10:49:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.705s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab3323e-9a68-4e1b-9d71-b60465512bb8]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzXQJaws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.743s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== connect_volume: return (1745ms) {'type': 'block', 'scsi_wwn': '23531313530396563', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531313530396563', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1026268862',display_name='tempest-TestVolumeBootPattern-server-1026268862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1026268862',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-ur8ky20n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:49:49Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=4141e6d3-176d-4736-a836-373cd04d5f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'pci_devices' on Instance uuid 4141e6d3-176d-4736-a836-373cd04d5f6d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:49:58 user nova-compute[75073]:   <uuid>4141e6d3-176d-4736-a836-373cd04d5f6d</uuid>
Nov 24 10:49:58 user nova-compute[75073]:   <name>instance-00000029</name>
Nov 24 10:49:58 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:49:58 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:49:58 user nova-compute[75073]:   <metadata>
Nov 24 10:49:58 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:49:58 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:49:58 user nova-compute[75073]:       <nova:name>tempest-TestVolumeBootPattern-server-1026268862</nova:name>
Nov 24 10:49:58 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:49:56</nova:creationTime>
Nov 24 10:49:58 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:49:58 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:49:58 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:49:58 user nova-compute[75073]:       <nova:owner>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:user uuid="d8baa21b464846dcb42dd244e4434e6a">tempest-TestVolumeBootPattern-1949066801-project-member</nova:user>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:project uuid="f60805f65e934beb8c272dfb1f74b042">tempest-TestVolumeBootPattern-1949066801</nova:project>
Nov 24 10:49:58 user nova-compute[75073]:       </nova:owner>
Nov 24 10:49:58 user nova-compute[75073]:       <nova:ports>
Nov 24 10:49:58 user nova-compute[75073]:         <nova:port uuid="0c0f786b-031d-4c93-8b37-ffdbc703ef62">
Nov 24 10:49:58 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 10:49:58 user nova-compute[75073]:         </nova:port>
Nov 24 10:49:58 user nova-compute[75073]:       </nova:ports>
Nov 24 10:49:58 user nova-compute[75073]:     </nova:instance>
Nov 24 10:49:58 user nova-compute[75073]:   </metadata>
Nov 24 10:49:58 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:49:58 user nova-compute[75073]:     <system>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="serial">4141e6d3-176d-4736-a836-373cd04d5f6d</entry>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="uuid">4141e6d3-176d-4736-a836-373cd04d5f6d</entry>
Nov 24 10:49:58 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:49:58 user nova-compute[75073]:     </system>
Nov 24 10:49:58 user nova-compute[75073]:   </sysinfo>
Nov 24 10:49:58 user nova-compute[75073]:   <os>
Nov 24 10:49:58 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:49:58 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:49:58 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:49:58 user nova-compute[75073]:   </os>
Nov 24 10:49:58 user nova-compute[75073]:   <features>
Nov 24 10:49:58 user nova-compute[75073]:     <acpi/>
Nov 24 10:49:58 user nova-compute[75073]:     <apic/>
Nov 24 10:49:58 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:49:58 user nova-compute[75073]:   </features>
Nov 24 10:49:58 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:49:58 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:49:58 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:49:58 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:49:58 user nova-compute[75073]:   </clock>
Nov 24 10:49:58 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:49:58 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:49:58 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:49:58 user nova-compute[75073]:   </cpu>
Nov 24 10:49:58 user nova-compute[75073]:   <devices>
Nov 24 10:49:58 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 10:49:58 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:49:58 user nova-compute[75073]:       <source dev="/dev/sdc"/>
Nov 24 10:49:58 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:49:58 user nova-compute[75073]:       <serial>6c629be9-66aa-4e9a-8f4b-54ceef1eddb2</serial>
Nov 24 10:49:58 user nova-compute[75073]:     </disk>
Nov 24 10:49:58 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:49:58 user nova-compute[75073]:       <mac address="fa:16:3e:f3:19:f7"/>
Nov 24 10:49:58 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:49:58 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:49:58 user nova-compute[75073]:       <target dev="tap0c0f786b-03"/>
Nov 24 10:49:58 user nova-compute[75073]:     </interface>
Nov 24 10:49:58 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:49:58 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/4141e6d3-176d-4736-a836-373cd04d5f6d/console.log" append="off"/>
Nov 24 10:49:58 user nova-compute[75073]:     </serial>
Nov 24 10:49:58 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:49:58 user nova-compute[75073]:     <video>
Nov 24 10:49:58 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:49:58 user nova-compute[75073]:     </video>
Nov 24 10:49:58 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:49:58 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:49:58 user nova-compute[75073]:     </rng>
Nov 24 10:49:58 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:49:58 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:49:58 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:49:58 user nova-compute[75073]:     </memballoon>
Nov 24 10:49:58 user nova-compute[75073]:   </devices>
Nov 24 10:49:58 user nova-compute[75073]: </domain>
Nov 24 10:49:58 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1026268862',display_name='tempest-TestVolumeBootPattern-server-1026268862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1026268862',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-ur8ky20n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:49:49Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=4141e6d3-176d-4736-a836-373cd04d5f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG os_vif [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98795961-02a4-52d1-b31e-c3eaa551bae8', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c0f786b-03, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c0f786b-03, col_values=(('qos', UUID('e995b106-142e-4a16-b632-40a1c0b5df8f')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c0f786b-03, col_values=(('external_ids', {'iface-id': '0c0f786b-031d-4c93-8b37-ffdbc703ef62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:19:f7', 'vm-uuid': '4141e6d3-176d-4736-a836-373cd04d5f6d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:58 user nova-compute[75073]: INFO os_vif [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03')
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:49:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] No VIF found with MAC fa:16:3e:f3:19:f7, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b -F raw /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk" returned: 0 in 2.416s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Ensure instance console log exists: /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start _get_guest_xml network_info=[{"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='77ea14ba2708c66809ae60d017be889b',container_format='bare',created_at=2023-11-24T10:47:59Z,direct_url=<?>,disk_format='qcow2',id=e843e40c-905b-4311-a225-539bcc1d53df,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1864752710-shelved',owner='51ada50f2ea94c2286e5986bbf106f53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T10:48:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:49:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='77ea14ba2708c66809ae60d017be889b',container_format='bare',created_at=2023-11-24T10:47:59Z,direct_url=<?>,disk_format='qcow2',id=e843e40c-905b-4311-a225-539bcc1d53df,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1864752710-shelved',owner='51ada50f2ea94c2286e5986bbf106f53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T10:48:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'vcpu_model' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.objects.base [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<c72a667c-efdb-46fa-b3dc-1a168caec542> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='e843e40c-905b-4311-a225-539bcc1d53df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-433871786',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:48:03.496967',shelved_host='user',shelved_image_id='e843e40c-905b-4311-a225-539bcc1d53df'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'pci_devices' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.objects.base [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Object Instance<c72a667c-efdb-46fa-b3dc-1a168caec542> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:49:59 user nova-compute[75073]:   <uuid>c72a667c-efdb-46fa-b3dc-1a168caec542</uuid>
Nov 24 10:49:59 user nova-compute[75073]:   <name>instance-00000023</name>
Nov 24 10:49:59 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:49:59 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:49:59 user nova-compute[75073]:   <metadata>
Nov 24 10:49:59 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:49:59 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1864752710</nova:name>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:49:59</nova:creationTime>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:49:59 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:49:59 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:owner>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:user uuid="e546129896f04ea89b745a89af5d8519">tempest-AttachVolumeShelveTestJSON-435396144-project-member</nova:user>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:project uuid="51ada50f2ea94c2286e5986bbf106f53">tempest-AttachVolumeShelveTestJSON-435396144</nova:project>
Nov 24 10:49:59 user nova-compute[75073]:       </nova:owner>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:root type="image" uuid="e843e40c-905b-4311-a225-539bcc1d53df"/>
Nov 24 10:49:59 user nova-compute[75073]:       <nova:ports>
Nov 24 10:49:59 user nova-compute[75073]:         <nova:port uuid="bbd06bda-805c-45a9-9521-d506d6923e28">
Nov 24 10:49:59 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:49:59 user nova-compute[75073]:         </nova:port>
Nov 24 10:49:59 user nova-compute[75073]:       </nova:ports>
Nov 24 10:49:59 user nova-compute[75073]:     </nova:instance>
Nov 24 10:49:59 user nova-compute[75073]:   </metadata>
Nov 24 10:49:59 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:49:59 user nova-compute[75073]:     <system>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="serial">c72a667c-efdb-46fa-b3dc-1a168caec542</entry>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="uuid">c72a667c-efdb-46fa-b3dc-1a168caec542</entry>
Nov 24 10:49:59 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:49:59 user nova-compute[75073]:     </system>
Nov 24 10:49:59 user nova-compute[75073]:   </sysinfo>
Nov 24 10:49:59 user nova-compute[75073]:   <os>
Nov 24 10:49:59 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:49:59 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:49:59 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:49:59 user nova-compute[75073]:   </os>
Nov 24 10:49:59 user nova-compute[75073]:   <features>
Nov 24 10:49:59 user nova-compute[75073]:     <acpi/>
Nov 24 10:49:59 user nova-compute[75073]:     <apic/>
Nov 24 10:49:59 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:49:59 user nova-compute[75073]:   </features>
Nov 24 10:49:59 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:49:59 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:49:59 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:49:59 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:49:59 user nova-compute[75073]:   </clock>
Nov 24 10:49:59 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:49:59 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:49:59 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:49:59 user nova-compute[75073]:   </cpu>
Nov 24 10:49:59 user nova-compute[75073]:   <devices>
Nov 24 10:49:59 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:49:59 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:49:59 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk"/>
Nov 24 10:49:59 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:49:59 user nova-compute[75073]:     </disk>
Nov 24 10:49:59 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:49:59 user nova-compute[75073]:       <mac address="fa:16:3e:2f:14:7e"/>
Nov 24 10:49:59 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:49:59 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:49:59 user nova-compute[75073]:       <target dev="tapbbd06bda-80"/>
Nov 24 10:49:59 user nova-compute[75073]:     </interface>
Nov 24 10:49:59 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:49:59 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/console.log" append="off"/>
Nov 24 10:49:59 user nova-compute[75073]:     </serial>
Nov 24 10:49:59 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:49:59 user nova-compute[75073]:     <video>
Nov 24 10:49:59 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:49:59 user nova-compute[75073]:     </video>
Nov 24 10:49:59 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:49:59 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:49:59 user nova-compute[75073]:     </rng>
Nov 24 10:49:59 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:49:59 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:49:59 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:49:59 user nova-compute[75073]:     </memballoon>
Nov 24 10:49:59 user nova-compute[75073]:   </devices>
Nov 24 10:49:59 user nova-compute[75073]: </domain>
Nov 24 10:49:59 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='e843e40c-905b-4311-a225-539bcc1d53df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-433871786',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member',shelved_at='2023-11-24T10:48:03.496967',shelved_host='user',shelved_image_id='e843e40c-905b-4311-a225-539bcc1d53df'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG os_vif [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49f99ee9-a293-50ee-b343-bf9c59efc39c', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbd06bda-80, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbd06bda-80, col_values=(('qos', UUID('a80944b0-f1a8-405f-b94e-a30393763059')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbd06bda-80, col_values=(('external_ids', {'iface-id': 'bbd06bda-805c-45a9-9521-d506d6923e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:14:7e', 'vm-uuid': 'c72a667c-efdb-46fa-b3dc-1a168caec542'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:49:59 user nova-compute[75073]: INFO os_vif [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80')
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:49:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] No VIF found with MAC fa:16:3e:2f:14:7e, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG nova.compute.manager [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] No waiting events found dispatching network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:00 user nova-compute[75073]: WARNING nova.compute.manager [req-343240ab-1230-4937-ab88-bca3ca17299c req-0b9e32b8-6d1d-4a1a-ab7f-1eec781fdd21 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received unexpected event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 for instance with vm_state building and task_state spawning.
Nov 24 10:50:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] No waiting events found dispatching network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:02 user nova-compute[75073]: WARNING nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received unexpected event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 for instance with vm_state building and task_state spawning.
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:02 user nova-compute[75073]: WARNING nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:02 user nova-compute[75073]: WARNING nova.compute.manager [req-3bc3ca5a-e613-4666-b93a-2c84be83a662 req-f8b8bd5c-2a98-4761-8f38-4474e96d8b69 service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:50:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:50:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:50:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:50:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:50:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:50:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:50:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Instance spawned successfully.
Nov 24 10:50:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:04 user nova-compute[75073]: INFO nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Took 7.46 seconds to spawn the instance on the hypervisor.
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:50:04 user nova-compute[75073]: INFO nova.compute.manager [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Took 15.94 seconds to build instance.
Nov 24 10:50:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a852d7f2-7824-48e1-968f-2da01aea187d tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.053s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:50:04 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance spawned successfully.
Nov 24 10:50:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:50:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-57bfe6d9-51b9-4e04-93ce-58209ad87e08 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.874s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:50:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:47 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:50:47 user nova-compute[75073]: INFO nova.compute.claims [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Claim successful on node user
Nov 24 10:50:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:50:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.policy [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ef13ee0365340eab76be49b157992b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ba4e5720bb41388d3f3a3af5c9f8c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:50:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Creating image(s)
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "/opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "/opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.327s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.247s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk 1073741824" returned: 0 in 0.059s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Successfully created port: 63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.216s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Cannot resize image /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Ensure instance console log exists: /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Successfully updated port: 63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-changed-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.compute.manager [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Refreshing instance network info cache due to event network-changed-63838b8a-de1f-4c98-8427-c4fbc7af10ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:50:49 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.neutron [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Instance network_info: |[{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Refreshing network info cache for port 63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Start _get_guest_xml network_info=[{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:50:50 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:50:50 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074451984',display_name='tempest-SnapshotDataIntegrityTests-server-2074451984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074451984',id=42,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDubqhBDlqoYhfNhC4N5ZW5kv0Tk+zdWgq9hMmHTZofE/aVgB+O5YCMbXw60eOIhz81VidufFDSvHb9LlnloQZFaPnuXp5UfVm0uggz5mkqsxmzKlhnc6qWlXRFP9yu4dw==',key_name='tempest-keypair-564483353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ba4e5720bb41388d3f3a3af5c9f8c0',ramdisk_id='',reservation_id='r-3dhz2vtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1751718283',owner_user_name='tempest-SnapshotDataIntegrityTests-1751718283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef13ee0365340eab76be49b157992b1',uuid=0ef3b4a2-5b5b-4103-a218-6596d81309ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converting VIF {"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:50:50 user nova-compute[75073]:   <uuid>0ef3b4a2-5b5b-4103-a218-6596d81309ec</uuid>
Nov 24 10:50:50 user nova-compute[75073]:   <name>instance-0000002a</name>
Nov 24 10:50:50 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:50:50 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:50:50 user nova-compute[75073]:   <metadata>
Nov 24 10:50:50 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:50:50 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2074451984</nova:name>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:50:50</nova:creationTime>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:50:50 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:50:50 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:owner>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:user uuid="6ef13ee0365340eab76be49b157992b1">tempest-SnapshotDataIntegrityTests-1751718283-project-member</nova:user>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:project uuid="d0ba4e5720bb41388d3f3a3af5c9f8c0">tempest-SnapshotDataIntegrityTests-1751718283</nova:project>
Nov 24 10:50:50 user nova-compute[75073]:       </nova:owner>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:50:50 user nova-compute[75073]:       <nova:ports>
Nov 24 10:50:50 user nova-compute[75073]:         <nova:port uuid="63838b8a-de1f-4c98-8427-c4fbc7af10ea">
Nov 24 10:50:50 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 10:50:50 user nova-compute[75073]:         </nova:port>
Nov 24 10:50:50 user nova-compute[75073]:       </nova:ports>
Nov 24 10:50:50 user nova-compute[75073]:     </nova:instance>
Nov 24 10:50:50 user nova-compute[75073]:   </metadata>
Nov 24 10:50:50 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:50:50 user nova-compute[75073]:     <system>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="serial">0ef3b4a2-5b5b-4103-a218-6596d81309ec</entry>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="uuid">0ef3b4a2-5b5b-4103-a218-6596d81309ec</entry>
Nov 24 10:50:50 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:50:50 user nova-compute[75073]:     </system>
Nov 24 10:50:50 user nova-compute[75073]:   </sysinfo>
Nov 24 10:50:50 user nova-compute[75073]:   <os>
Nov 24 10:50:50 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:50:50 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:50:50 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:50:50 user nova-compute[75073]:   </os>
Nov 24 10:50:50 user nova-compute[75073]:   <features>
Nov 24 10:50:50 user nova-compute[75073]:     <acpi/>
Nov 24 10:50:50 user nova-compute[75073]:     <apic/>
Nov 24 10:50:50 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:50:50 user nova-compute[75073]:   </features>
Nov 24 10:50:50 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:50:50 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:50:50 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:50:50 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:50:50 user nova-compute[75073]:   </clock>
Nov 24 10:50:50 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:50:50 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:50:50 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:50:50 user nova-compute[75073]:   </cpu>
Nov 24 10:50:50 user nova-compute[75073]:   <devices>
Nov 24 10:50:50 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:50:50 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:50:50 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk"/>
Nov 24 10:50:50 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:50:50 user nova-compute[75073]:     </disk>
Nov 24 10:50:50 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:50:50 user nova-compute[75073]:       <mac address="fa:16:3e:6c:d6:88"/>
Nov 24 10:50:50 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:50:50 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:50:50 user nova-compute[75073]:       <target dev="tap63838b8a-de"/>
Nov 24 10:50:50 user nova-compute[75073]:     </interface>
Nov 24 10:50:50 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:50:50 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/console.log" append="off"/>
Nov 24 10:50:50 user nova-compute[75073]:     </serial>
Nov 24 10:50:50 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:50:50 user nova-compute[75073]:     <video>
Nov 24 10:50:50 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:50:50 user nova-compute[75073]:     </video>
Nov 24 10:50:50 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:50:50 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:50:50 user nova-compute[75073]:     </rng>
Nov 24 10:50:50 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:50:50 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:50:50 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:50:50 user nova-compute[75073]:     </memballoon>
Nov 24 10:50:50 user nova-compute[75073]:   </devices>
Nov 24 10:50:50 user nova-compute[75073]: </domain>
Nov 24 10:50:50 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074451984',display_name='tempest-SnapshotDataIntegrityTests-server-2074451984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074451984',id=42,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDubqhBDlqoYhfNhC4N5ZW5kv0Tk+zdWgq9hMmHTZofE/aVgB+O5YCMbXw60eOIhz81VidufFDSvHb9LlnloQZFaPnuXp5UfVm0uggz5mkqsxmzKlhnc6qWlXRFP9yu4dw==',key_name='tempest-keypair-564483353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ba4e5720bb41388d3f3a3af5c9f8c0',ramdisk_id='',reservation_id='r-3dhz2vtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1751718283',owner_user_name='tempest-SnapshotDataIntegrityTests-1751718283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef13ee0365340eab76be49b157992b1',uuid=0ef3b4a2-5b5b-4103-a218-6596d81309ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converting VIF {"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG os_vif [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0398988-9064-56e7-9ae9-f70502384b20', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63838b8a-de, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63838b8a-de, col_values=(('qos', UUID('f6996fd6-dab7-4eee-9d8d-0992a02f82ca')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63838b8a-de, col_values=(('external_ids', {'iface-id': '63838b8a-de1f-4c98-8427-c4fbc7af10ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:d6:88', 'vm-uuid': '0ef3b4a2-5b5b-4103-a218-6596d81309ec'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:50 user nova-compute[75073]: INFO os_vif [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de')
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No VIF found with MAC fa:16:3e:6c:d6:88, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updated VIF entry in instance network info cache for port 63838b8a-de1f-4c98-8427-c4fbc7af10ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:50:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3568c2fe-442e-4958-acca-19e755c05110 req-a33635a2-daa2-4b9c-ad2c-b50b3b3c6dd3 service nova] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:50:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:53 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:53 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:50:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Instance spawned successfully.
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:50:54 user nova-compute[75073]: INFO nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 24 10:50:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:50:54 user nova-compute[75073]: INFO nova.compute.manager [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Took 6.37 seconds to build instance.
Nov 24 10:50:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9ec8ccc-666e-475f-b93c-921ba028f690 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.462s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] No waiting events found dispatching network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:56 user nova-compute[75073]: WARNING nova.compute.manager [req-0cabb982-554f-4cc2-b295-3640ca525683 req-1e1988be-2ab6-4e82-9034-53ee54d2c40e service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received unexpected event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea for instance with vm_state active and task_state None.
Nov 24 10:50:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:50:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG nova.compute.manager [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] No waiting events found dispatching network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:50:58 user nova-compute[75073]: WARNING nova.compute.manager [req-c688409f-ee85-43d8-8eee-7135fb0463c6 req-af811d9d-f7ee-4ed3-b908-402a790cf98d service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received unexpected event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea for instance with vm_state active and task_state None.
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:50:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:50:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:50:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.310283660888672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ad5d4af5-6727-4e80-baef-a06224906f70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 4141e6d3-176d-4736-a836-373cd04d5f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance c72a667c-efdb-46fa-b3dc-1a168caec542 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:50:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:00 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:51:00 user nova-compute[75073]: INFO nova.compute.claims [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Claim successful on node user
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:51:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:51:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Creating image(s)
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "/opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "/opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "/opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.policy [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '219e480168c642a5b52cf36552dd708b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20fa8e30e8443a391b5ac10de5a84e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk 1073741824" returned: 0 in 0.077s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:51:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Cannot resize image /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Successfully created port: 278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Successfully updated port: 278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquired lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-changed-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.compute.manager [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Refreshing instance network info cache due to event network-changed-278ced67-dbbb-4613-bb08-2e849dd771f5. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] Acquiring lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:51:02 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.neutron [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating instance_info_cache with network_info: [{"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Releasing lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Instance network_info: |[{"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] Acquired lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Refreshing network info cache for port 278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Start _get_guest_xml network_info=[{"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:51:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:51:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1472753087',display_name='tempest-VolumesSnapshotTestJSON-instance-1472753087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1472753087',id=43,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbAGHz/H8HkHfnAotEohsc/+PfRRCzL3p2sCaYQlH64LFuId4SlGUrXPKCOTxJdYUYmDwwPaTf476hL3SCjlACwi2IC1hCCoXnT3dZb12q1B+ZypdvXCwUm7HciUgGGBg==',key_name='tempest-keypair-993187803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-p6pp8uh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=d69d0f55-0b31-456a-8d97-ac36092b05b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'pci_devices' on Instance uuid d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:51:03 user nova-compute[75073]:   <uuid>d69d0f55-0b31-456a-8d97-ac36092b05b9</uuid>
Nov 24 10:51:03 user nova-compute[75073]:   <name>instance-0000002b</name>
Nov 24 10:51:03 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:51:03 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:51:03 user nova-compute[75073]:   <metadata>
Nov 24 10:51:03 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:51:03 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1472753087</nova:name>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:51:03</nova:creationTime>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:51:03 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:51:03 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:owner>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:user uuid="219e480168c642a5b52cf36552dd708b">tempest-VolumesSnapshotTestJSON-1276131083-project-member</nova:user>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:project uuid="f20fa8e30e8443a391b5ac10de5a84e5">tempest-VolumesSnapshotTestJSON-1276131083</nova:project>
Nov 24 10:51:03 user nova-compute[75073]:       </nova:owner>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:51:03 user nova-compute[75073]:       <nova:ports>
Nov 24 10:51:03 user nova-compute[75073]:         <nova:port uuid="278ced67-dbbb-4613-bb08-2e849dd771f5">
Nov 24 10:51:03 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 10:51:03 user nova-compute[75073]:         </nova:port>
Nov 24 10:51:03 user nova-compute[75073]:       </nova:ports>
Nov 24 10:51:03 user nova-compute[75073]:     </nova:instance>
Nov 24 10:51:03 user nova-compute[75073]:   </metadata>
Nov 24 10:51:03 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:51:03 user nova-compute[75073]:     <system>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="serial">d69d0f55-0b31-456a-8d97-ac36092b05b9</entry>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="uuid">d69d0f55-0b31-456a-8d97-ac36092b05b9</entry>
Nov 24 10:51:03 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:51:03 user nova-compute[75073]:     </system>
Nov 24 10:51:03 user nova-compute[75073]:   </sysinfo>
Nov 24 10:51:03 user nova-compute[75073]:   <os>
Nov 24 10:51:03 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:51:03 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:51:03 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:51:03 user nova-compute[75073]:   </os>
Nov 24 10:51:03 user nova-compute[75073]:   <features>
Nov 24 10:51:03 user nova-compute[75073]:     <acpi/>
Nov 24 10:51:03 user nova-compute[75073]:     <apic/>
Nov 24 10:51:03 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:51:03 user nova-compute[75073]:   </features>
Nov 24 10:51:03 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:51:03 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:51:03 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:51:03 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:51:03 user nova-compute[75073]:   </clock>
Nov 24 10:51:03 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:51:03 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:51:03 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:51:03 user nova-compute[75073]:   </cpu>
Nov 24 10:51:03 user nova-compute[75073]:   <devices>
Nov 24 10:51:03 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:51:03 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:51:03 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk"/>
Nov 24 10:51:03 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:51:03 user nova-compute[75073]:     </disk>
Nov 24 10:51:03 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:51:03 user nova-compute[75073]:       <mac address="fa:16:3e:03:a5:28"/>
Nov 24 10:51:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:51:03 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:51:03 user nova-compute[75073]:       <target dev="tap278ced67-db"/>
Nov 24 10:51:03 user nova-compute[75073]:     </interface>
Nov 24 10:51:03 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:51:03 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/console.log" append="off"/>
Nov 24 10:51:03 user nova-compute[75073]:     </serial>
Nov 24 10:51:03 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:51:03 user nova-compute[75073]:     <video>
Nov 24 10:51:03 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:51:03 user nova-compute[75073]:     </video>
Nov 24 10:51:03 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:51:03 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:51:03 user nova-compute[75073]:     </rng>
Nov 24 10:51:03 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:51:03 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:51:03 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:51:03 user nova-compute[75073]:     </memballoon>
Nov 24 10:51:03 user nova-compute[75073]:   </devices>
Nov 24 10:51:03 user nova-compute[75073]: </domain>
Nov 24 10:51:03 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1472753087',display_name='tempest-VolumesSnapshotTestJSON-instance-1472753087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1472753087',id=43,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbAGHz/H8HkHfnAotEohsc/+PfRRCzL3p2sCaYQlH64LFuId4SlGUrXPKCOTxJdYUYmDwwPaTf476hL3SCjlACwi2IC1hCCoXnT3dZb12q1B+ZypdvXCwUm7HciUgGGBg==',key_name='tempest-keypair-993187803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-p6pp8uh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=d69d0f55-0b31-456a-8d97-ac36092b05b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG os_vif [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1fa893f-8bdf-5859-b0fb-57157115499b', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap278ced67-db, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap278ced67-db, col_values=(('qos', UUID('c0764136-7620-42f5-9c5e-592fb2fce310')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap278ced67-db, col_values=(('external_ids', {'iface-id': '278ced67-dbbb-4613-bb08-2e849dd771f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:a5:28', 'vm-uuid': 'd69d0f55-0b31-456a-8d97-ac36092b05b9'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:03 user nova-compute[75073]: INFO os_vif [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db')
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No VIF found with MAC fa:16:3e:03:a5:28, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updated VIF entry in instance network info cache for port 278ced67-dbbb-4613-bb08-2e849dd771f5. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating instance_info_cache with network_info: [{"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3b69d60d-792b-430c-961d-aa408ceadd9d req-f8dc62e9-3b9b-4c2e-bb2e-7353694c084a service nova] Releasing lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:51:03 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] No waiting events found dispatching network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:04 user nova-compute[75073]: WARNING nova.compute.manager [req-27180685-b7c7-4b12-a4a7-9d62ddfbaa78 req-8e32adde-2860-4249-9367-8d9f260d5a8f service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received unexpected event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 for instance with vm_state building and task_state spawning.
Nov 24 10:51:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:51:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Skipping network cache update for instance because it is Building. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid ad5d4af5-6727-4e80-baef-a06224906f70 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:51:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Instance spawned successfully.
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.compute.manager [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] No waiting events found dispatching network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:06 user nova-compute[75073]: WARNING nova.compute.manager [req-266b3108-c551-48b3-bf83-55b07bc56451 req-fd9ed389-ae13-4f4f-beca-06ab429a4816 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received unexpected event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 for instance with vm_state building and task_state spawning.
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:51:06 user nova-compute[75073]: INFO nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 24 10:51:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:51:06 user nova-compute[75073]: INFO nova.compute.manager [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Took 6.20 seconds to build instance.
Nov 24 10:51:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a99a26e-189b-4398-95ae-e8dd770d8073 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing instance network info cache due to event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] Acquiring lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] Acquired lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:51:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updated VIF entry in instance network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating instance_info_cache with network_info: [{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7e9b19ec-cc64-41a6-bbc2-b2c9a1baef2c req-b56a3193-c47d-45d7-9312-d1e7767ff633 service nova] Releasing lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing instance network info cache due to event network-changed-0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] Acquiring lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] Acquired lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Refreshing network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:40 user nova-compute[75073]: INFO nova.compute.manager [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Terminating instance
Nov 24 10:51:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updated VIF entry in instance network info cache for port 0c0f786b-031d-4c93-8b37-ffdbc703ef62. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating instance_info_cache with network_info: [{"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-99611697-e147-4335-a7f2-70a74a77c027 req-6ae4d9a1-53f8-45e1-a2e5-1702d03787be service nova] Releasing lock "refresh_cache-4141e6d3-176d-4736-a836-373cd04d5f6d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:51:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Instance destroyed successfully.
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid 4141e6d3-176d-4736-a836-373cd04d5f6d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1026268862',display_name='tempest-TestVolumeBootPattern-server-1026268862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1026268862',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-ur8ky20n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:50:04Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=4141e6d3-176d-4736-a836-373cd04d5f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "address": "fa:16:3e:f3:19:f7", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0f786b-03", "ovs_interfaceid": "0c0f786b-031d-4c93-8b37-ffdbc703ef62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_vif [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c0f786b-03, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e995b106-142e-4a16-b632-40a1c0b5df8f) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:41 user nova-compute[75073]: INFO os_vif [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:19:f7,bridge_name='br-int',has_traffic_filtering=True,id=0c0f786b-031d-4c93-8b37-ffdbc703ef62,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0f786b-03')
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzXQJaws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:51:41 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f8bca-ed29-419d-bbe8-87d955361f8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:51:41 user nova-compute[75073]: No targets found.
Nov 24 10:51:41 user nova-compute[75073]: iSNS:
Nov 24 10:51:41 user nova-compute[75073]: No targets found.
Nov 24 10:51:41 user nova-compute[75073]: STATIC:
Nov 24 10:51:41 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e
Nov 24 10:51:41 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:51:41 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:51:41 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2
Nov 24 10:51:41 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:51:41 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:51:41 user nova-compute[75073]: FIRMWARE:
Nov 24 10:51:41 user nova-compute[75073]: No targets found.
Nov 24 10:51:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:51:41 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:51:41 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e204dcc-0554-469d-9afc-9d8f174f3229]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d24597-e79b-4341-8d93-efd4d81f9679]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:51:41 user nova-compute[75073]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)
Nov 24 10:51:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:51:41 user nova-compute[75073]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 (non-flash)
Nov 24 10:51:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238201bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7cb77-f102-46b8-92a7-3eb35dd8c30e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1b245-0f0c-41a6-9816-1c66ceef5bb6]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d5c2b-01ea-4ddf-a11c-cb00143ecd1d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23340aeb-163a-4af7-a5cd-61c06bf634e8]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f756dc3-e9d3-45b3-ba8c-0a0181f433c7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-unplugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] No waiting events found dispatching network-vif-unplugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-unplugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Acquiring lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] No waiting events found dispatching network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:41 user nova-compute[75073]: WARNING nova.compute.manager [req-4fe8bd38-a4ad-4128-b2b0-919ae8a42c47 req-dce8b1c2-dede-466d-87b1-3d622a1d2261 service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received unexpected event network-vif-plugged-0c0f786b-031d-4c93-8b37-ffdbc703ef62 for instance with vm_state active and task_state deleting.
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb04169-bda8-4f0c-91f4-a116c848ce5e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260]
Nov 24 10:51:41 user nova-compute[75073]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2, portal: 172.16.0.220,3260] successful.
Nov 24 10:51:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c629be9-66aa-4e9a-8f4b-54ceef1eddb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[734236a7-cc78-4b47-be21-823b4cdc80d9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (312ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:51:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:51:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Deleting instance files /opt/stack/data/nova/instances/4141e6d3-176d-4736-a836-373cd04d5f6d_del
Nov 24 10:51:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Deletion of /opt/stack/data/nova/instances/4141e6d3-176d-4736-a836-373cd04d5f6d_del complete
Nov 24 10:51:42 user nova-compute[75073]: INFO nova.compute.manager [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:42 user nova-compute[75073]: INFO nova.compute.manager [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Terminating instance
Nov 24 10:51:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:42 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Took 0.41 seconds to deallocate network for instance.
Nov 24 10:51:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Instance destroyed successfully.
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.objects.instance [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lazy-loading 'resources' on Instance uuid c72a667c-efdb-46fa-b3dc-1a168caec542 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T10:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1864752710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1864752710',id=35,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxMqLy/3vopOEWpNCQB/yRTgw2DZ7E5aiOMVVK3a51LaH/n6ltd3dFS2XB4DuYo7c1V5vhomJlFhwRStmQitredXlT+ptcMrRm59m31Ew6R3H9lT3x741GYYG15OE7eYw==',key_name='tempest-keypair-433871786',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51ada50f2ea94c2286e5986bbf106f53',ramdisk_id='',reservation_id='r-cgsem8sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-435396144',owner_user_name='tempest-AttachVolumeShelveTestJSON-435396144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e546129896f04ea89b745a89af5d8519',uuid=c72a667c-efdb-46fa-b3dc-1a168caec542,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converting VIF {"id": "bbd06bda-805c-45a9-9521-d506d6923e28", "address": "fa:16:3e:2f:14:7e", "network": {"id": "256b70f5-fd97-4b31-9ae1-5777736487ab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1489206135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ada50f2ea94c2286e5986bbf106f53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbd06bda-80", "ovs_interfaceid": "bbd06bda-805c-45a9-9521-d506d6923e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG os_vif [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbd06bda-80, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a80944b0-f1a8-405f-b94e-a30393763059) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:43 user nova-compute[75073]: INFO os_vif [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:14:7e,bridge_name='br-int',has_traffic_filtering=True,id=bbd06bda-805c-45a9-9521-d506d6923e28,network=Network(256b70f5-fd97-4b31-9ae1-5777736487ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbd06bda-80')
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Deleting instance files /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542_del
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Deletion of /opt/stack/data/nova/instances/c72a667c-efdb-46fa-b3dc-1a168caec542_del complete
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.compute.manager [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Took 0.82 seconds to detach 1 volumes for instance.
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.compute.manager [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:43 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance 4141e6d3-176d-4736-a836-373cd04d5f6d
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a80323cb-6aad-4e2d-bf1f-ac4ca25ffbe5 tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "4141e6d3-176d-4736-a836-373cd04d5f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: 4141e6d3-176d-4736-a836-373cd04d5f6d] Received event network-vif-deleted-0c0f786b-031d-4c93-8b37-ffdbc703ef62 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-unplugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Acquiring lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] No waiting events found dispatching network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:51:43 user nova-compute[75073]: WARNING nova.compute.manager [req-62dc0365-9db1-4717-a03d-1568143a79a7 req-afa0875d-fcad-4475-969a-9da95129e97b service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received unexpected event network-vif-plugged-bbd06bda-805c-45a9-9521-d506d6923e28 for instance with vm_state active and task_state deleting.
Nov 24 10:51:44 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:51:44 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Took 0.77 seconds to deallocate network for instance.
Nov 24 10:51:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:44 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:51:44 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:51:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:44 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Deleted allocations for instance c72a667c-efdb-46fa-b3dc-1a168caec542
Nov 24 10:51:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-21db2e72-5eb0-4007-9510-b999814fb387 tempest-AttachVolumeShelveTestJSON-435396144 tempest-AttachVolumeShelveTestJSON-435396144-project-member] Lock "c72a667c-efdb-46fa-b3dc-1a168caec542" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-81cdbdc5-b65b-4843-b94c-601201997426 req-cce84d4b-b65b-4f68-92af-5ef904d0663d service nova] [instance: c72a667c-efdb-46fa-b3dc-1a168caec542] Received event network-vif-deleted-bbd06bda-805c-45a9-9521-d506d6923e28 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:51:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:51:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:51:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:51:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:51:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:51:59 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=25.26471710205078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ad5d4af5-6727-4e80-baef-a06224906f70 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d69d0f55-0b31-456a-8d97-ac36092b05b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:52:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:52:01 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:04 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:52:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:04 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:52:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-changed-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Refreshing instance network info cache due to event network-changed-63838b8a-de1f-4c98-8427-c4fbc7af10ea. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:38 user nova-compute[75073]: DEBUG nova.network.neutron [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Refreshing network info cache for port 63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:52:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updated VIF entry in instance network info cache for port 63838b8a-de1f-4c98-8427-c4fbc7af10ea. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:52:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a9481f1-5a9a-4752-8dd4-e395e0d0bf0f req-30e1b022-87ec-4108-9c21-8b289a193b11 service nova] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing instance network info cache due to event network-changed-1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] Acquiring lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] Acquired lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Refreshing network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:40 user nova-compute[75073]: INFO nova.compute.manager [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Terminating instance
Nov 24 10:52:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-unplugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] No waiting events found dispatching network-vif-unplugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-27692dc2-ebca-4d25-bf33-9cf6c8c8d533 req-4a95d343-6804-439a-98c9-8e1d747f243d service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-unplugged-1727bd93-a1b0-4784-928c-20f8625e14a6 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updated VIF entry in instance network info cache for port 1727bd93-a1b0-4784-928c-20f8625e14a6. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [{"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-10b0ce70-a820-4c16-ade9-4013fc58c9c4 req-8bd544b5-d97a-4af7-8db2-87870aaf06a5 service nova] Releasing lock "refresh_cache-ad5d4af5-6727-4e80-baef-a06224906f70" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Instance destroyed successfully.
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lazy-loading 'resources' on Instance uuid ad5d4af5-6727-4e80-baef-a06224906f70 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343020732',display_name='tempest-TestVolumeBootPattern-server-1343020732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343020732',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwrD7LGwXwaYfV99DLmRGrI76qoE5QUt/rdcDirSvSqJ1MO/2j8bU29bQbMHVBNyOgHYTy5Rm2sE+ZvD1Q612O4yXex/vmmD6s7hgmVdfnH82nMEjHe+k6jQbKpyEXstg==',key_name='tempest-TestVolumeBootPattern-2135745054',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60805f65e934beb8c272dfb1f74b042',ramdisk_id='',reservation_id='r-p04qv1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1949066801',owner_user_name='tempest-TestVolumeBootPattern-1949066801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:48:01Z,user_data=None,user_id='d8baa21b464846dcb42dd244e4434e6a',uuid=ad5d4af5-6727-4e80-baef-a06224906f70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converting VIF {"id": "1727bd93-a1b0-4784-928c-20f8625e14a6", "address": "fa:16:3e:45:7d:af", "network": {"id": "937cccbb-c039-4d0e-8198-e243bb29a7fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2005972259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60805f65e934beb8c272dfb1f74b042", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1727bd93-a1", "ovs_interfaceid": "1727bd93-a1b0-4784-928c-20f8625e14a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_vif [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1727bd93-a1, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fab289b0-4639-4cda-9473-e6ebb891b4ac) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:52:41 user nova-compute[75073]: INFO os_vif [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1727bd93-a1b0-4784-928c-20f8625e14a6,network=Network(937cccbb-c039-4d0e-8198-e243bb29a7fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1727bd93-a1')
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XjGhDinv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:52:41 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393d5fa-b670-4353-b209-88c60ff2ed43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:52:41 user nova-compute[75073]: No targets found.
Nov 24 10:52:41 user nova-compute[75073]: iSNS:
Nov 24 10:52:41 user nova-compute[75073]: No targets found.
Nov 24 10:52:41 user nova-compute[75073]: STATIC:
Nov 24 10:52:41 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e
Nov 24 10:52:41 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:52:41 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:52:41 user nova-compute[75073]: FIRMWARE:
Nov 24 10:52:41 user nova-compute[75073]: No targets found.
Nov 24 10:52:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:52:41 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:52:41 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[34498ec5-7fbf-4dcd-902b-2b90bea94208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4494b-91f1-4053-90c2-e05199aec8b9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:52:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e (non-flash)
Nov 24 10:52:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382168c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa5b83d-77d9-4a48-a13c-388033274052]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f05cd8-d05f-4810-9d37-d46264521043]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f928b3-854f-483c-b92a-53caebcd9771]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeb5642-a67f-49c1-9d12-0602284c8ef3]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_864d70a7', '/dev/disk/by-id/scsi-1SCST_BIO864d70a7-8a86d4cbe413bae1', '/dev/disk/by-id/scsi-23861383664346362') {{(pid=85267) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6512c03c-017f-4054-9d6b-3ab71b275363]: (4, None) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55ba4a-8d3c-486f-b91d-3a891c6ad7e5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4fc31-9cca-46ce-9d9c-d8b22614a6e4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260]
Nov 24 10:52:41 user nova-compute[75073]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e, portal: 172.16.0.220,3260] successful.
Nov 24 10:52:41 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18c9bf5a-e01a-483a-bc7b-1cc4c246649e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0325539c-6fe9-4333-b0b5-9e9249fb3ca8]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] <== disconnect_volume: return (337ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:52:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Deleting instance files /opt/stack/data/nova/instances/ad5d4af5-6727-4e80-baef-a06224906f70_del
Nov 24 10:52:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Deletion of /opt/stack/data/nova/instances/ad5d4af5-6727-4e80-baef-a06224906f70_del complete
Nov 24 10:52:41 user nova-compute[75073]: INFO nova.compute.manager [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 24 10:52:41 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:52:41 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:52:42 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:42 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Took 0.46 seconds to deallocate network for instance.
Nov 24 10:52:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] Acquiring lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] Lock "ad5d4af5-6727-4e80-baef-a06224906f70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] No waiting events found dispatching network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:52:43 user nova-compute[75073]: WARNING nova.compute.manager [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received unexpected event network-vif-plugged-1727bd93-a1b0-4784-928c-20f8625e14a6 for instance with vm_state active and task_state deleting.
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f342851-01f9-4e1b-be16-d9def865980b req-82a49fe3-f97a-4e8d-a5da-e56100ae9613 service nova] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Received event network-vif-deleted-1727bd93-a1b0-4784-928c-20f8625e14a6 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:43 user nova-compute[75073]: INFO nova.compute.manager [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] [instance: ad5d4af5-6727-4e80-baef-a06224906f70] Took 0.77 seconds to detach 1 volumes for instance.
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:43 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Deleted allocations for instance ad5d4af5-6727-4e80-baef-a06224906f70
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9827e693-e075-4387-80df-35242dd450ed tempest-TestVolumeBootPattern-1949066801 tempest-TestVolumeBootPattern-1949066801-project-member] Lock "ad5d4af5-6727-4e80-baef-a06224906f70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:44 user nova-compute[75073]: INFO nova.compute.manager [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attaching volume a5b7692e-e48a-4a2e-847e-6dfe411d95ef to /dev/vdb
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.utils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f45433-07d2-4125-b72c-320b8110b874]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e0872-e8c0-48f5-a861-bfc85b3b0fda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa1d040-4895-4048-bd0d-380854626a3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a83a48-8c7f-49b2-9a74-046e11785f80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:52:44 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:52:44 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c5b87e-dacf-4ea4-bd5e-ce197ed216f3]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG os_brick.utils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating existing volume attachment record: ba4e0438-4f8a-431f-a051-25947e16d4a6 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:52:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGeJYVvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:52:50 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:52:50 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:52:50 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[42655a3e-255c-457d-a7c0-0e29a50512dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:52:50 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e33d1-248c-4e38-99ae-5d02fcd87a54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef] added
Nov 24 10:52:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd5822e-eff8-47ea-acc5-540212f47656]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6112dc1d-503c-495e-ab3a-cf7ed554a393]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGeJYVvt {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGeJYVvt" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f621fb-45e0-421f-af39-c15820d2806a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGeJYVvt'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f956bed0-6b14-43d4-8fd0-1be5e8a91b1f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50903e0-da8b-4638-86d3-10cb7b20023e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:52:50 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:52:50 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:52:50 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:52:50 user nova-compute[75073]: 
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f3cfe-2606-40d7-9331-8899ef6e5008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260]
Nov 24 10:52:50 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260] successful.
Nov 24 10:52:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[075a5304-c7f5-40f2-a08e-ee9f0c95edfa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ae7fd-3cfc-48c6-ae13-235c52887bfb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926a8cf-2bc1-4c51-a633-fba34f8768f0]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGeJYVvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-changed-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Refreshing instance network info cache due to event network-changed-278ced67-dbbb-4613-bb08-2e849dd771f5. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] Acquiring lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] Acquired lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Refreshing network info cache for port 278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Ignoring supplied device name: /dev/vdb
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:51 user nova-compute[75073]: INFO nova.compute.manager [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Attaching volume 695a87a5-b3bc-4609-86a9-6580d6935fc6 to /dev/vdb
Nov 24 10:52:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.utils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2058bb2-e985-4f7e-8d21-845d079d1af7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[db20be21-79ce-4900-ab3b-8b81169c861f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd3f78b-be77-4b7c-a7d6-8aed006f0d05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[adffcdc9-4f19-42a9-832b-dc054c47c0bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:52:51 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40fccb-32e1-4332-8163-a59c839ea77f]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.utils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating existing volume attachment record: 4f50cdda-60d4-4ec2-a806-65ce879f9bfe {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updated VIF entry in instance network info cache for port 278ced67-dbbb-4613-bb08-2e849dd771f5. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.network.neutron [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating instance_info_cache with network_info: [{"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3df1aae9-b8a4-4176-8f1b-0410e86d22f8 req-96472263-a7c7-4144-be0e-484b23fb185e service nova] Releasing lock "refresh_cache-d69d0f55-0b31-456a-8d97-ac36092b05b9" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23262303639613236', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262303639613236', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:52:51 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:52:51 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:52:51 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:52:51 user nova-compute[75073]:   <serial>a5b7692e-e48a-4a2e-847e-6dfe411d95ef</serial>
Nov 24 10:52:51 user nova-compute[75073]: </disk>
Nov 24 10:52:51 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:52:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:52:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:52:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No VIF found with MAC fa:16:3e:6c:d6:88, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:52:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c22be773-d429-4775-a29b-d5c81ced9ef8 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.253s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:52:54 user nova-compute[75073]: INFO nova.compute.claims [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Claim successful on node user
Nov 24 10:52:54 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:52:55 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.policy [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016b326ea3eb4679a05c71c8ebd74763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156576cab144c73be55e1acc81af148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:52:55 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Creating image(s)
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "/opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:55 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk 1073741824" returned: 0 in 0.060s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Successfully created port: 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.188s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Cannot resize image /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Ensure instance console log exists: /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Successfully updated port: 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquired lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-changed-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG nova.compute.manager [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Refreshing instance network info cache due to event network-changed-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:52:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] Acquiring lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.neutron [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Releasing lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Instance network_info: |[{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] Acquired lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Refreshing network info cache for port 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Start _get_guest_xml network_info=[{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:52:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:52:57 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109475389',display_name='tempest-AttachVolumeNegativeTest-server-109475389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109475389',id=44,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHQHXfOVK6tMCnvYiPs8ewdtiBb4CyIa8ejAUyDBBrlzpmc+5biEV22KeZJzI3XMwrrClITh3+LRXiJCIuumnHwbvGlf/JnOsBVvfXE0i1Iy5rWClS9Ln12D5Xq6pTYCA==',key_name='tempest-keypair-1831016798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-x0094jis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=3317d418-538c-43f9-bb99-6f6aa19a2391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.objects.instance [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'pci_devices' on Instance uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:52:57 user nova-compute[75073]:   <uuid>3317d418-538c-43f9-bb99-6f6aa19a2391</uuid>
Nov 24 10:52:57 user nova-compute[75073]:   <name>instance-0000002c</name>
Nov 24 10:52:57 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:52:57 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:52:57 user nova-compute[75073]:   <metadata>
Nov 24 10:52:57 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:52:57 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeNegativeTest-server-109475389</nova:name>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:52:57</nova:creationTime>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:52:57 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:52:57 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:owner>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:user uuid="016b326ea3eb4679a05c71c8ebd74763">tempest-AttachVolumeNegativeTest-323602591-project-member</nova:user>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:project uuid="d156576cab144c73be55e1acc81af148">tempest-AttachVolumeNegativeTest-323602591</nova:project>
Nov 24 10:52:57 user nova-compute[75073]:       </nova:owner>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:52:57 user nova-compute[75073]:       <nova:ports>
Nov 24 10:52:57 user nova-compute[75073]:         <nova:port uuid="03e40ca5-ef21-4a1a-a3a1-756b8cb99e02">
Nov 24 10:52:57 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 10:52:57 user nova-compute[75073]:         </nova:port>
Nov 24 10:52:57 user nova-compute[75073]:       </nova:ports>
Nov 24 10:52:57 user nova-compute[75073]:     </nova:instance>
Nov 24 10:52:57 user nova-compute[75073]:   </metadata>
Nov 24 10:52:57 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:52:57 user nova-compute[75073]:     <system>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="serial">3317d418-538c-43f9-bb99-6f6aa19a2391</entry>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="uuid">3317d418-538c-43f9-bb99-6f6aa19a2391</entry>
Nov 24 10:52:57 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:52:57 user nova-compute[75073]:     </system>
Nov 24 10:52:57 user nova-compute[75073]:   </sysinfo>
Nov 24 10:52:57 user nova-compute[75073]:   <os>
Nov 24 10:52:57 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:52:57 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:52:57 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:52:57 user nova-compute[75073]:   </os>
Nov 24 10:52:57 user nova-compute[75073]:   <features>
Nov 24 10:52:57 user nova-compute[75073]:     <acpi/>
Nov 24 10:52:57 user nova-compute[75073]:     <apic/>
Nov 24 10:52:57 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:52:57 user nova-compute[75073]:   </features>
Nov 24 10:52:57 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:52:57 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:52:57 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:52:57 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:52:57 user nova-compute[75073]:   </clock>
Nov 24 10:52:57 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:52:57 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:52:57 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:52:57 user nova-compute[75073]:   </cpu>
Nov 24 10:52:57 user nova-compute[75073]:   <devices>
Nov 24 10:52:57 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:52:57 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:52:57 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk"/>
Nov 24 10:52:57 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:52:57 user nova-compute[75073]:     </disk>
Nov 24 10:52:57 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:52:57 user nova-compute[75073]:       <mac address="fa:16:3e:7a:8a:6f"/>
Nov 24 10:52:57 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:52:57 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:52:57 user nova-compute[75073]:       <target dev="tap03e40ca5-ef"/>
Nov 24 10:52:57 user nova-compute[75073]:     </interface>
Nov 24 10:52:57 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:52:57 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/console.log" append="off"/>
Nov 24 10:52:57 user nova-compute[75073]:     </serial>
Nov 24 10:52:57 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:52:57 user nova-compute[75073]:     <video>
Nov 24 10:52:57 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:52:57 user nova-compute[75073]:     </video>
Nov 24 10:52:57 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:52:57 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:52:57 user nova-compute[75073]:     </rng>
Nov 24 10:52:57 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:52:57 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:52:57 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:52:57 user nova-compute[75073]:     </memballoon>
Nov 24 10:52:57 user nova-compute[75073]:   </devices>
Nov 24 10:52:57 user nova-compute[75073]: </domain>
Nov 24 10:52:57 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109475389',display_name='tempest-AttachVolumeNegativeTest-server-109475389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109475389',id=44,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHQHXfOVK6tMCnvYiPs8ewdtiBb4CyIa8ejAUyDBBrlzpmc+5biEV22KeZJzI3XMwrrClITh3+LRXiJCIuumnHwbvGlf/JnOsBVvfXE0i1Iy5rWClS9Ln12D5Xq6pTYCA==',key_name='tempest-keypair-1831016798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-x0094jis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=3317d418-538c-43f9-bb99-6f6aa19a2391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_vif [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f88706d-f932-5bb1-8d5e-cdc71484fc13', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03e40ca5-ef, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03e40ca5-ef, col_values=(('qos', UUID('3c8d4f26-d7fe-4ecd-853a-e654cf1adb3a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03e40ca5-ef, col_values=(('external_ids', {'iface-id': '03e40ca5-ef21-4a1a-a3a1-756b8cb99e02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:8a:6f', 'vm-uuid': '3317d418-538c-43f9-bb99-6f6aa19a2391'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: INFO os_vif [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef')
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:7a:8a:6f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updated VIF entry in instance network info cache for port 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.network.neutron [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ef6905d7-da5c-4537-b7b5-5dcf3f68a1bc req-e2b46153-13ab-4fb4-97fe-e4d24eaf5eea service nova] Releasing lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDhpjMtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:52:57 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:52:57 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:52:57 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecbfe6e-9b0a-4ef2-87e7-0436b8bde3d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:52:57 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[93259f5d-2c29-4f11-a7d1-9cc11704d9b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6] added
Nov 24 10:52:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e07eeb-abb8-498c-9561-50efbebc9cbe]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723f315-acc7-49ba-9e56-f6f5d8fa6f42]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDhpjMtJ {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDhpjMtJ" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9637d-598a-4a23-951a-145391612d2d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDhpjMtJ'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca885c9-e6e3-4000-a631-95314015ca29]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8d9d07-fdb6-482d-966d-6425e9abfbe2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e669361-770f-4734-8a57-eb4092839349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:57 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260]
Nov 24 10:52:57 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260] successful.
Nov 24 10:52:57 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d9a19-08fd-4ec7-a1d6-e58390750a55]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc242811-5b99-4301-bee1-5d0c3636ea74]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:58 user nova-compute[75073]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:52:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:52:58 user nova-compute[75073]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:52:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed430fb0-dced-4473-9a82-fbd43da0f9fa]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDhpjMtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:58 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26166316435376363', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166316435376363', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.compute.manager [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] No waiting events found dispatching network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:52:59 user nova-compute[75073]: WARNING nova.compute.manager [req-7dda3bf7-1e7e-4260-9f30-0eb860a81134 req-0a777ea4-cffa-4081-98bc-15a47b132e11 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received unexpected event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 for instance with vm_state building and task_state spawning.
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:52:59 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:52:59 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:52:59 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:52:59 user nova-compute[75073]:   <serial>695a87a5-b3bc-4609-86a9-6580d6935fc6</serial>
Nov 24 10:52:59 user nova-compute[75073]: </disk>
Nov 24 10:52:59 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No VIF found with MAC fa:16:3e:03:a5:28, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d528f462-b55d-4882-93ca-26200a32fac9 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.402s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:52:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] No waiting events found dispatching network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:53:01 user nova-compute[75073]: WARNING nova.compute.manager [req-ca49f66a-ec86-4422-a186-7daebaa7bc8e req-74bcaec7-841d-4326-8f0f-2c2be7d4444c service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received unexpected event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 for instance with vm_state building and task_state spawning.
Nov 24 10:53:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:53:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.25366973876953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance d69d0f55-0b31-456a-8d97-ac36092b05b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:53:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Instance spawned successfully.
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:53:01 user nova-compute[75073]: INFO nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:01 user nova-compute[75073]: INFO nova.compute.manager [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Took 6.93 seconds to build instance.
Nov 24 10:53:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-6c894e2e-c042-4910-ad5b-6cc87b1e7df4 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.106s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:05 user nova-compute[75073]: INFO nova.compute.manager [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Detaching volume a5b7692e-e48a-4a2e-847e-6dfe411d95ef
Nov 24 10:53:05 user nova-compute[75073]: INFO nova.virt.block_device [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attempting to driver detach volume a5b7692e-e48a-4a2e-847e-6dfe411d95ef from mountpoint /dev/vdb
Nov 24 10:53:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Attempting to detach device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:53:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:53:05 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:53:05 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:53:05 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:53:05 user nova-compute[75073]:   <serial>a5b7692e-e48a-4a2e-847e-6dfe411d95ef</serial>
Nov 24 10:53:05 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:53:05 user nova-compute[75073]: </disk>
Nov 24 10:53:05 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:53:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config.
Nov 24 10:53:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:53:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:53:05 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:53:05 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:53:05 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:53:05 user nova-compute[75073]:   <serial>a5b7692e-e48a-4a2e-847e-6dfe411d95ef</serial>
Nov 24 10:53:05 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:53:05 user nova-compute[75073]: </disk>
Nov 24 10:53:05 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:53:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:53:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:53:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:53:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:20 user nova-compute[75073]: INFO nova.compute.manager [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Detaching volume 695a87a5-b3bc-4609-86a9-6580d6935fc6
Nov 24 10:53:20 user nova-compute[75073]: INFO nova.virt.block_device [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Attempting to driver detach volume 695a87a5-b3bc-4609-86a9-6580d6935fc6 from mountpoint /dev/vdb
Nov 24 10:53:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Attempting to detach device vdb from instance d69d0f55-0b31-456a-8d97-ac36092b05b9 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:53:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:53:20 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:53:20 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:53:20 user nova-compute[75073]:   <serial>695a87a5-b3bc-4609-86a9-6580d6935fc6</serial>
Nov 24 10:53:20 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:53:20 user nova-compute[75073]: </disk>
Nov 24 10:53:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:53:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully detached device vdb from instance d69d0f55-0b31-456a-8d97-ac36092b05b9 from the persistent domain config.
Nov 24 10:53:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d69d0f55-0b31-456a-8d97-ac36092b05b9 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:53:20 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:53:20 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:53:20 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:53:20 user nova-compute[75073]:   <serial>695a87a5-b3bc-4609-86a9-6580d6935fc6</serial>
Nov 24 10:53:20 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:53:20 user nova-compute[75073]: </disk>
Nov 24 10:53:20 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:53:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:53:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:26 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec is timed out.
Nov 24 10:53:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config.
Nov 24 10:53:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGeJYVvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:53:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e33c21-e8ac-4530-9f80-75a9ed89efcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:53:26 user nova-compute[75073]: No targets found.
Nov 24 10:53:26 user nova-compute[75073]: iSNS:
Nov 24 10:53:26 user nova-compute[75073]: No targets found.
Nov 24 10:53:26 user nova-compute[75073]: STATIC:
Nov 24 10:53:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6
Nov 24 10:53:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:53:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:53:26 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef
Nov 24 10:53:26 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:53:26 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:53:26 user nova-compute[75073]: FIRMWARE:
Nov 24 10:53:26 user nova-compute[75073]: No targets found.
Nov 24 10:53:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:53:26 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:53:26 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1314f5-90bd-409d-8392-41ba699019ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c6642a-85fa-4d44-a4fb-a8252129af6e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:53:26 user nova-compute[75073]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:53:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef (non-flash)
Nov 24 10:53:26 user nova-compute[75073]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:53:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238246d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9fb6cf-f26b-4883-8c33-43325aa05084]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[839946d1-1944-4703-a6bb-78ab81d2f0aa]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a4307-d62e-4c57-9219-ae80d0f650bd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48420a9e-c35f-4ccb-b079-f8db685fac5a]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a8280-c885-48d3-b0a8-cef5384c3d4e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410251c-7d0d-44b9-b648-c46645d14052]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260]
Nov 24 10:53:26 user nova-compute[75073]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef, portal: 172.16.0.220,3260] successful.
Nov 24 10:53:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b7692e-e48a-4a2e-847e-6dfe411d95ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3084ca0-d1bc-417c-a1b7-1abc536f27b9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== disconnect_volume: return (285ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:53:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:53:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:27 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:53:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c0614564-40e4-4906-9d50-4cf7ee1e7173 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:40 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d69d0f55-0b31-456a-8d97-ac36092b05b9 is timed out.
Nov 24 10:53:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully detached device vdb from instance d69d0f55-0b31-456a-8d97-ac36092b05b9 from the live domain config.
Nov 24 10:53:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDhpjMtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:53:40 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b7f47-da2a-422b-b93c-e59b73cd0fb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:53:40 user nova-compute[75073]: No targets found.
Nov 24 10:53:40 user nova-compute[75073]: iSNS:
Nov 24 10:53:40 user nova-compute[75073]: No targets found.
Nov 24 10:53:40 user nova-compute[75073]: STATIC:
Nov 24 10:53:40 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6
Nov 24 10:53:40 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:53:40 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:53:40 user nova-compute[75073]: FIRMWARE:
Nov 24 10:53:40 user nova-compute[75073]: No targets found.
Nov 24 10:53:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:53:40 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:53:40 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2cb07f-606c-404f-8b8a-22ca2f50995b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9618dd7-a05e-482f-947d-5f17c7363ba9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:53:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 (non-flash)
Nov 24 10:53:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238244670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[34efb44d-6cbd-43ef-ae9f-1fd01f2375fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d11d5d-d57f-4256-bdac-099320641728]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e36317-84d8-477b-a3be-6d8849e571c5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3acec-3502-434c-a017-4086f0d9e2e4]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[03447885-6fa0-4611-ba9d-3f69a0010641]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c85efe-3030-4a8d-a79c-c0f43765ab0f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260]
Nov 24 10:53:40 user nova-compute[75073]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6, portal: 172.16.0.220,3260] successful.
Nov 24 10:53:40 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402057c-73ea-4836-8e42-60a0de4b3368]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== disconnect_volume: return (279ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:53:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG nova.objects.instance [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-e06ba49c-5f8d-4d9d-bd2d-155d222b2800 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.561s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:41 user nova-compute[75073]: INFO nova.compute.manager [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Terminating instance
Nov 24 10:53:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG nova.compute.manager [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-unplugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:53:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] No waiting events found dispatching network-vif-unplugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-c2e7985f-06d1-431f-8307-ad7b5bc6d193 req-3e5ed6ef-b203-42b3-a184-d16faceddfc9 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-unplugged-278ced67-dbbb-4613-bb08-2e849dd771f5 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Instance destroyed successfully.
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.objects.instance [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'resources' on Instance uuid d69d0f55-0b31-456a-8d97-ac36092b05b9 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1472753087',display_name='tempest-VolumesSnapshotTestJSON-instance-1472753087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1472753087',id=43,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbAGHz/H8HkHfnAotEohsc/+PfRRCzL3p2sCaYQlH64LFuId4SlGUrXPKCOTxJdYUYmDwwPaTf476hL3SCjlACwi2IC1hCCoXnT3dZb12q1B+ZypdvXCwUm7HciUgGGBg==',key_name='tempest-keypair-993187803',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-p6pp8uh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:51:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=d69d0f55-0b31-456a-8d97-ac36092b05b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "278ced67-dbbb-4613-bb08-2e849dd771f5", "address": "fa:16:3e:03:a5:28", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278ced67-db", "ovs_interfaceid": "278ced67-dbbb-4613-bb08-2e849dd771f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_vif [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap278ced67-db, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0764136-7620-42f5-9c5e-592fb2fce310) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:53:42 user nova-compute[75073]: INFO os_vif [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:a5:28,bridge_name='br-int',has_traffic_filtering=True,id=278ced67-dbbb-4613-bb08-2e849dd771f5,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278ced67-db')
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:695a87a5-b3bc-4609-86a9-6580d6935fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDhpjMtJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:53:42 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3eac0444-cb02-46b3-ac1b-388e70010bbd]: Unexpected error while running command.
Nov 24 10:53:42 user nova-compute[75073]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 24 10:53:42 user nova-compute[75073]: Exit code: 21
Nov 24 10:53:42 user nova-compute[75073]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 24 10:53:42 user nova-compute[75073]: Stderr: '' {{(pid=85267) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 24 10:53:42 user nova-compute[75073]: Traceback (most recent call last):
Nov 24 10:53:42 user nova-compute[75073]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 24 10:53:42 user nova-compute[75073]:     ret = func(*f_args, **f_kwargs)
Nov 24 10:53:42 user nova-compute[75073]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 24 10:53:42 user nova-compute[75073]:     return func(*args, **kwargs)
Nov 24 10:53:42 user nova-compute[75073]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 24 10:53:42 user nova-compute[75073]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 24 10:53:42 user nova-compute[75073]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 24 10:53:42 user nova-compute[75073]:     return putils.execute(on_execute=on_execute,
Nov 24 10:53:42 user nova-compute[75073]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 24 10:53:42 user nova-compute[75073]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 24 10:53:42 user nova-compute[75073]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 24 10:53:42 user nova-compute[75073]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 24 10:53:42 user nova-compute[75073]: Exit code: 21
Nov 24 10:53:42 user nova-compute[75073]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 24 10:53:42 user nova-compute[75073]: Stderr: ''
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac0444-cb02-46b3-ac1b-388e70010bbd]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 24 10:53:42 user nova-compute[75073]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 24 10:53:42 user nova-compute[75073]: Exit code: 21
Nov 24 10:53:42 user nova-compute[75073]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 24 10:53:42 user nova-compute[75073]: Stderr: ''
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 24 10:53:42 user nova-compute[75073]: ERROR os_brick.initiator.connectors.iscsi 
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75073) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== disconnect_volume: return (70ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:53:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Deleting instance files /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9_del
Nov 24 10:53:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Deletion of /opt/stack/data/nova/instances/d69d0f55-0b31-456a-8d97-ac36092b05b9_del complete
Nov 24 10:53:42 user nova-compute[75073]: INFO nova.compute.manager [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 24 10:53:42 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:53:42 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:53:43 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Took 0.92 seconds to deallocate network for instance.
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-4eb9905b-1b85-4ac0-b8e8-544ac0d71691 req-82beb962-b2c6-4dc8-8ac7-58a6c932f888 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-deleted-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:53:43 user nova-compute[75073]: INFO nova.compute.manager [req-4eb9905b-1b85-4ac0-b8e8-544ac0d71691 req-82beb962-b2c6-4dc8-8ac7-58a6c932f888 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Neutron deleted interface 278ced67-dbbb-4613-bb08-2e849dd771f5; detaching it from the instance and deleting it from the info cache
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-4eb9905b-1b85-4ac0-b8e8-544ac0d71691 req-82beb962-b2c6-4dc8-8ac7-58a6c932f888 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:53:43 user nova-compute[75073]: WARNING nova.volume.cinder [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Attachment 4f50cdda-60d4-4ec2-a806-65ce879f9bfe does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4f50cdda-60d4-4ec2-a806-65ce879f9bfe. (HTTP 404) (Request-ID: req-1d58b4c1-a6fc-4e94-a349-7530064e5db1)
Nov 24 10:53:43 user nova-compute[75073]: INFO nova.compute.manager [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Took 0.03 seconds to detach 1 volumes for instance.
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-4eb9905b-1b85-4ac0-b8e8-544ac0d71691 req-82beb962-b2c6-4dc8-8ac7-58a6c932f888 service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Detach interface failed, port_id=278ced67-dbbb-4613-bb08-2e849dd771f5, reason: Instance d69d0f55-0b31-456a-8d97-ac36092b05b9 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:53:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:43 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Deleted allocations for instance d69d0f55-0b31-456a-8d97-ac36092b05b9
Nov 24 10:53:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-dc5f347b-9d48-43a2-ac8a-42c8d697c7d2 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:53:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] Acquiring lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] Lock "d69d0f55-0b31-456a-8d97-ac36092b05b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] No waiting events found dispatching network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:53:44 user nova-compute[75073]: WARNING nova.compute.manager [req-c319c510-1669-444f-8190-be444ca52501 req-50cf75d6-f8ad-4092-a3a6-8cfbfa4979cc service nova] [instance: d69d0f55-0b31-456a-8d97-ac36092b05b9] Received unexpected event network-vif-plugged-278ced67-dbbb-4613-bb08-2e849dd771f5 for instance with vm_state deleted and task_state None.
Nov 24 10:53:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:53:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:53:55 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:53:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:53:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:53:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:58 user nova-compute[75073]: DEBUG nova.objects.instance [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:53:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:53:59 user nova-compute[75073]: INFO nova.compute.manager [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attaching volume cd4205e7-4e58-468c-aa3a-0aeb7f803c5c to /dev/vdb
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.utils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73a8b17-e375-4fba-9721-038045264c20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca163ee4-6e61-44db-a635-cea0763d5ced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed654c2-fe7c-457b-8a4d-8e2966682471]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[196004d0-e14d-4955-84ae-f66526a0078a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:53:59 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:53:59 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d95b6-5786-4de6-9536-076b706ac9d3]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG os_brick.utils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:53:59 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating existing volume attachment record: e8751e4d-87c1-4591-81b7-454f4b34c6f4 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:54:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:54:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:54:01 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.251068115234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:54:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEHTqORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:54:05 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:54:05 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:54:05 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacf1734-32e5-4dc0-a3be-75d1f41908be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:54:05 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c6175-1318-4651-af43-5b0b6014a1bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c] added
Nov 24 10:54:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeffc59-d8b9-4061-a39c-c576c6fbcdfa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a08bc9-2270-4dbc-a107-eb0a1afdee39]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEHTqORN {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mEHTqORN" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27602732-6b5f-41ab-9cf1-a8f5e4e3b798]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mEHTqORN'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268a068-b3d8-46b8-bbe7-37916d01df80]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b680585-eb7c-4f99-8884-2e82ec2cbc3d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:54:05 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:54:05 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:54:05 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:54:05 user nova-compute[75073]: 
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[502d5e28-82a6-40f6-a5bc-4b50d9f7eea3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260]
Nov 24 10:54:05 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260] successful.
Nov 24 10:54:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[599ba8e0-a504-47de-bf0a-37c19bec91a4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5dd574-85ad-4360-a518-29d4e4a2979d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)
Nov 24 10:54:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)
Nov 24 10:54:05 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c12d13-94e6-4be5-8837-e11cba229909]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:05 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEHTqORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23662316366333637', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662316366333637', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.objects.instance [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:54:06 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:54:06 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:54:06 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:54:06 user nova-compute[75073]:   <serial>cd4205e7-4e58-468c-aa3a-0aeb7f803c5c</serial>
Nov 24 10:54:06 user nova-compute[75073]: </disk>
Nov 24 10:54:06 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:54:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No VIF found with MAC fa:16:3e:6c:d6:88, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-af23642c-e8cf-43c7-acf4-b0cb2f2f640f tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.986s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:09 user nova-compute[75073]: INFO nova.compute.manager [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Detaching volume cd4205e7-4e58-468c-aa3a-0aeb7f803c5c
Nov 24 10:54:09 user nova-compute[75073]: INFO nova.virt.block_device [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attempting to driver detach volume cd4205e7-4e58-468c-aa3a-0aeb7f803c5c from mountpoint /dev/vdb
Nov 24 10:54:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Attempting to detach device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:54:09 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:54:09 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:54:09 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:54:09 user nova-compute[75073]:   <serial>cd4205e7-4e58-468c-aa3a-0aeb7f803c5c</serial>
Nov 24 10:54:09 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:54:09 user nova-compute[75073]: </disk>
Nov 24 10:54:09 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:54:09 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config.
Nov 24 10:54:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:54:09 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:54:09 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:54:09 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:54:09 user nova-compute[75073]:   <serial>cd4205e7-4e58-468c-aa3a-0aeb7f803c5c</serial>
Nov 24 10:54:09 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:54:09 user nova-compute[75073]: </disk>
Nov 24 10:54:09 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:54:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:54:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:54:27 user nova-compute[75073]: INFO nova.compute.claims [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Claim successful on node user
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:54:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.policy [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '219e480168c642a5b52cf36552dd708b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20fa8e30e8443a391b5ac10de5a84e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:54:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Creating image(s)
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "/opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "/opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "/opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk 1073741824" returned: 0 in 0.056s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Cannot resize image /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Ensure instance console log exists: /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Successfully created port: 7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Successfully updated port: 7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquired lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:54:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-changed-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Refreshing instance network info cache due to event network-changed-7007458f-8ce6-4c46-99d5-b4e83edd3d13. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] Acquiring lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updating instance_info_cache with network_info: [{"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Releasing lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Instance network_info: |[{"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] Acquired lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Refreshing network info cache for port 7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Start _get_guest_xml network_info=[{"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:54:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:54:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642840068',display_name='tempest-VolumesSnapshotTestJSON-instance-642840068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642840068',id=45,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbypwf/w7DjwvtCEZrDFVS2w20XIRR7yqkno430+XPqWxFNebJ3oe782sgbWY8Vn1Lx+rf9nVbbMj2ces+FASKsLsG9LNk3gS+kSTeGzA3eNhkZWatyqI8JdDgwqCz3eg==',key_name='tempest-keypair-1753458590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-fyhgkjiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=48d3c467-452c-449c-937d-2cae851b2faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'pci_devices' on Instance uuid 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:54:29 user nova-compute[75073]:   <uuid>48d3c467-452c-449c-937d-2cae851b2faa</uuid>
Nov 24 10:54:29 user nova-compute[75073]:   <name>instance-0000002d</name>
Nov 24 10:54:29 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:54:29 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:54:29 user nova-compute[75073]:   <metadata>
Nov 24 10:54:29 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:54:29 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-642840068</nova:name>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:54:29</nova:creationTime>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:54:29 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:54:29 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:owner>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:user uuid="219e480168c642a5b52cf36552dd708b">tempest-VolumesSnapshotTestJSON-1276131083-project-member</nova:user>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:project uuid="f20fa8e30e8443a391b5ac10de5a84e5">tempest-VolumesSnapshotTestJSON-1276131083</nova:project>
Nov 24 10:54:29 user nova-compute[75073]:       </nova:owner>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:54:29 user nova-compute[75073]:       <nova:ports>
Nov 24 10:54:29 user nova-compute[75073]:         <nova:port uuid="7007458f-8ce6-4c46-99d5-b4e83edd3d13">
Nov 24 10:54:29 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 10:54:29 user nova-compute[75073]:         </nova:port>
Nov 24 10:54:29 user nova-compute[75073]:       </nova:ports>
Nov 24 10:54:29 user nova-compute[75073]:     </nova:instance>
Nov 24 10:54:29 user nova-compute[75073]:   </metadata>
Nov 24 10:54:29 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:54:29 user nova-compute[75073]:     <system>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="serial">48d3c467-452c-449c-937d-2cae851b2faa</entry>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="uuid">48d3c467-452c-449c-937d-2cae851b2faa</entry>
Nov 24 10:54:29 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:54:29 user nova-compute[75073]:     </system>
Nov 24 10:54:29 user nova-compute[75073]:   </sysinfo>
Nov 24 10:54:29 user nova-compute[75073]:   <os>
Nov 24 10:54:29 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:54:29 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:54:29 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:54:29 user nova-compute[75073]:   </os>
Nov 24 10:54:29 user nova-compute[75073]:   <features>
Nov 24 10:54:29 user nova-compute[75073]:     <acpi/>
Nov 24 10:54:29 user nova-compute[75073]:     <apic/>
Nov 24 10:54:29 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:54:29 user nova-compute[75073]:   </features>
Nov 24 10:54:29 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:54:29 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:54:29 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:54:29 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:54:29 user nova-compute[75073]:   </clock>
Nov 24 10:54:29 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:54:29 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:54:29 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:54:29 user nova-compute[75073]:   </cpu>
Nov 24 10:54:29 user nova-compute[75073]:   <devices>
Nov 24 10:54:29 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:54:29 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:54:29 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk"/>
Nov 24 10:54:29 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:54:29 user nova-compute[75073]:     </disk>
Nov 24 10:54:29 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:54:29 user nova-compute[75073]:       <mac address="fa:16:3e:e4:3f:bf"/>
Nov 24 10:54:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:54:29 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:54:29 user nova-compute[75073]:       <target dev="tap7007458f-8c"/>
Nov 24 10:54:29 user nova-compute[75073]:     </interface>
Nov 24 10:54:29 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:54:29 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/console.log" append="off"/>
Nov 24 10:54:29 user nova-compute[75073]:     </serial>
Nov 24 10:54:29 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:54:29 user nova-compute[75073]:     <video>
Nov 24 10:54:29 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:54:29 user nova-compute[75073]:     </video>
Nov 24 10:54:29 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:54:29 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:54:29 user nova-compute[75073]:     </rng>
Nov 24 10:54:29 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:54:29 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:54:29 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:54:29 user nova-compute[75073]:     </memballoon>
Nov 24 10:54:29 user nova-compute[75073]:   </devices>
Nov 24 10:54:29 user nova-compute[75073]: </domain>
Nov 24 10:54:29 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642840068',display_name='tempest-VolumesSnapshotTestJSON-instance-642840068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642840068',id=45,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbypwf/w7DjwvtCEZrDFVS2w20XIRR7yqkno430+XPqWxFNebJ3oe782sgbWY8Vn1Lx+rf9nVbbMj2ces+FASKsLsG9LNk3gS+kSTeGzA3eNhkZWatyqI8JdDgwqCz3eg==',key_name='tempest-keypair-1753458590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-fyhgkjiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=48d3c467-452c-449c-937d-2cae851b2faa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_vif [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9687f2a5-4659-5e20-9b4c-6711116cac17', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7007458f-8c, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7007458f-8c, col_values=(('qos', UUID('3e9a3fd2-5494-4f18-8899-bb591d10f07e')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7007458f-8c, col_values=(('external_ids', {'iface-id': '7007458f-8ce6-4c46-99d5-b4e83edd3d13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:3f:bf', 'vm-uuid': '48d3c467-452c-449c-937d-2cae851b2faa'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:29 user nova-compute[75073]: INFO os_vif [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c')
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No VIF found with MAC fa:16:3e:e4:3f:bf, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updated VIF entry in instance network info cache for port 7007458f-8ce6-4c46-99d5-b4e83edd3d13. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updating instance_info_cache with network_info: [{"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cdbb40ac-389d-4028-8ee3-0109d70f1e1d req-3016fe67-2a4e-4d60-a17e-384d7a0dc928 service nova] Releasing lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:54:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec is timed out.
Nov 24 10:54:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config.
Nov 24 10:54:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mEHTqORN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:54:29 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b188d-e12e-4fea-9d82-bab44b3befc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:54:29 user nova-compute[75073]: No targets found.
Nov 24 10:54:29 user nova-compute[75073]: iSNS:
Nov 24 10:54:29 user nova-compute[75073]: No targets found.
Nov 24 10:54:29 user nova-compute[75073]: STATIC:
Nov 24 10:54:29 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c
Nov 24 10:54:29 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:54:29 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:54:29 user nova-compute[75073]: FIRMWARE:
Nov 24 10:54:29 user nova-compute[75073]: No targets found.
Nov 24 10:54:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:54:29 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:54:29 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b5f4ac-4f8d-4e10-806c-a8053c5bdc40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[218eec53-d472-4b2b-a32b-2963673673af]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)
Nov 24 10:54:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c (non-flash)
Nov 24 10:54:29 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23812f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f73557-d664-43be-83bf-90cd9570ff97]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bedd8eb-fd16-4ce0-b12e-8f2329060447]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fadf15-110b-430a-84b8-94bfda3ad741]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c69c8f-5ef4-4ca5-afb7-740f0a521ac5]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ededec-23db-4464-a1ab-448638f5a61b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b4c0a6-7c9d-45da-9c68-da744868ae37]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260]
Nov 24 10:54:30 user nova-compute[75073]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c, portal: 172.16.0.220,3260] successful.
Nov 24 10:54:30 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd4205e7-4e58-468c-aa3a-0aeb7f803c5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a6efd-6bfc-4173-b364-cab5c4e27061]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== disconnect_volume: return (265ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] No waiting events found dispatching network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:54:30 user nova-compute[75073]: WARNING nova.compute.manager [req-2cb06454-c277-49d2-9ad2-11fb0abe8706 req-4270c913-6fda-4500-81fe-0ccdc95b8870 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received unexpected event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 for instance with vm_state building and task_state spawning.
Nov 24 10:54:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-5c54fedc-8ff8-42ba-b503-306a7b7077f2 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:54:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Instance spawned successfully.
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:54:32 user nova-compute[75073]: INFO nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 24 10:54:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:54:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:54:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] No waiting events found dispatching network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:54:33 user nova-compute[75073]: WARNING nova.compute.manager [req-6343c048-dbeb-4b2a-b797-3b4240171773 req-7cdab57b-1d80-45e5-b4d6-3ddbfe548e6a service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received unexpected event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 for instance with vm_state building and task_state spawning.
Nov 24 10:54:33 user nova-compute[75073]: INFO nova.compute.manager [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Took 5.94 seconds to build instance.
Nov 24 10:54:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ffd221bc-7a94-4960-8eca-fb1861500873 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.032s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:54:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-changed-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG nova.compute.manager [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Refreshing instance network info cache due to event network-changed-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] Acquiring lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] Acquired lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Refreshing network info cache for port 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updated VIF entry in instance network info cache for port 03e40ca5-ef21-4a1a-a3a1-756b8cb99e02. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG nova.network.neutron [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:54:45 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-36e70934-277d-4545-bf86-85d17fd537fa req-33348556-141f-4eaf-8696-593414152c83 service nova] Releasing lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:54:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:47 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:48 user nova-compute[75073]: INFO nova.compute.manager [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Attaching volume f52e32cc-0c13-465b-aab9-b8a1eb5e107e to /dev/vdb
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.utils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3ff2a-c190-403c-beb7-c4edf5555189]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5a6015-6401-4959-bc23-a57807ac167e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6fe70-7046-4f33-be2c-56877227cace]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51e127-40ba-4d47-a97f-6eaba727fc49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:54:48 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:54:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3eb579-60ed-4f41-96cf-b0bb58b4c1c4]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG os_brick.utils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:54:48 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating existing volume attachment record: d18dc2ed-2f4a-4252-8fc6-976144e5e270 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:54:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahFwMiQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:54:53 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:54:53 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:54:53 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7a6d8-b411-401c-8934-4c54578333ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:54:53 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7c53b-f509-49e0-9475-76cda84fbfb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e] added
Nov 24 10:54:53 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8484d-b3f6-4d6a-a28e-24ac300c0ed5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d6c5be-3ab0-4b1f-a1f4-8dfc04ea27a4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahFwMiQz {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahFwMiQz" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e28d180-9625-4956-a672-9295e84adfe2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahFwMiQz'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:53 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd66bfdc-0ffc-4098-be5d-8627f4d76edc]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c8ce23-8e28-4b7d-aa04-507c88a2bd6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:54:54 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 10:54:54 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:54:54 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 10:54:54 user nova-compute[75073]: 
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[35262eca-bb5e-445e-9bdf-7b1b8ffcc465]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260]
Nov 24 10:54:54 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260] successful.
Nov 24 10:54:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0da301c-4fd3-4425-8903-8a696914b351]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b81f9-66ad-4013-8ce1-546417266517]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:54:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:54:54 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aab23b-842e-4b16-95e3-a6a55d93c41d]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:54:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahFwMiQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23837643963623138', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837643963623138', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:54:55 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:54:55 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:54:55 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:54:55 user nova-compute[75073]:   <serial>f52e32cc-0c13-465b-aab9-b8a1eb5e107e</serial>
Nov 24 10:54:55 user nova-compute[75073]: </disk>
Nov 24 10:54:55 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:7a:8a:6f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:54:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1bd1ca88-8e85-4cf0-a36f-298dff95a938 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.584s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:54:57 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:54:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:58 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:54:59 user nova-compute[75073]: INFO nova.compute.claims [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Claim successful on node user
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:54:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.policy [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016b326ea3eb4679a05c71c8ebd74763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156576cab144c73be55e1acc81af148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:54:59 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Creating image(s)
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk 1073741824" returned: 0 in 0.050s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:54:59 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.192s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Successfully created port: 104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Cannot resize image /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:55:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Successfully updated port: 104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquired lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-changed-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.compute.manager [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Refreshing instance network info cache due to event network-changed-104507a6-5e0f-41f7-8480-20a7719f0ef3. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] Acquiring lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updating instance_info_cache with network_info: [{"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Releasing lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Instance network_info: |[{"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] Acquired lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Refreshing network info cache for port 104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Start _get_guest_xml network_info=[{"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:55:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026393672',display_name='tempest-AttachVolumeNegativeTest-server-1026393672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026393672',id=46,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm+N0jCwnIuSLRfW0j+s2mYfxW7fIR/edsvqL7l57Oys8bcLc9T6h7pu3VBVCQJmuU/aLJ1h6lZ1NNlXJkz7ZGSyEGZRAzjvemzcuWWwVAIYiiUGrxEuhct0rKPC8JTpw==',key_name='tempest-keypair-1105248111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-fzimlxh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=1fa9da72-81b0-4980-9258-3696819e5986,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.objects.instance [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa9da72-81b0-4980-9258-3696819e5986 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:55:01 user nova-compute[75073]:   <uuid>1fa9da72-81b0-4980-9258-3696819e5986</uuid>
Nov 24 10:55:01 user nova-compute[75073]:   <name>instance-0000002e</name>
Nov 24 10:55:01 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:55:01 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:55:01 user nova-compute[75073]:   <metadata>
Nov 24 10:55:01 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:55:01 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1026393672</nova:name>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:55:01</nova:creationTime>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:55:01 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:55:01 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:owner>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:user uuid="016b326ea3eb4679a05c71c8ebd74763">tempest-AttachVolumeNegativeTest-323602591-project-member</nova:user>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:project uuid="d156576cab144c73be55e1acc81af148">tempest-AttachVolumeNegativeTest-323602591</nova:project>
Nov 24 10:55:01 user nova-compute[75073]:       </nova:owner>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:55:01 user nova-compute[75073]:       <nova:ports>
Nov 24 10:55:01 user nova-compute[75073]:         <nova:port uuid="104507a6-5e0f-41f7-8480-20a7719f0ef3">
Nov 24 10:55:01 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 10:55:01 user nova-compute[75073]:         </nova:port>
Nov 24 10:55:01 user nova-compute[75073]:       </nova:ports>
Nov 24 10:55:01 user nova-compute[75073]:     </nova:instance>
Nov 24 10:55:01 user nova-compute[75073]:   </metadata>
Nov 24 10:55:01 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:55:01 user nova-compute[75073]:     <system>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="serial">1fa9da72-81b0-4980-9258-3696819e5986</entry>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="uuid">1fa9da72-81b0-4980-9258-3696819e5986</entry>
Nov 24 10:55:01 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:55:01 user nova-compute[75073]:     </system>
Nov 24 10:55:01 user nova-compute[75073]:   </sysinfo>
Nov 24 10:55:01 user nova-compute[75073]:   <os>
Nov 24 10:55:01 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:55:01 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:55:01 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:55:01 user nova-compute[75073]:   </os>
Nov 24 10:55:01 user nova-compute[75073]:   <features>
Nov 24 10:55:01 user nova-compute[75073]:     <acpi/>
Nov 24 10:55:01 user nova-compute[75073]:     <apic/>
Nov 24 10:55:01 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:55:01 user nova-compute[75073]:   </features>
Nov 24 10:55:01 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:55:01 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:55:01 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:55:01 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:55:01 user nova-compute[75073]:   </clock>
Nov 24 10:55:01 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:55:01 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:55:01 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:55:01 user nova-compute[75073]:   </cpu>
Nov 24 10:55:01 user nova-compute[75073]:   <devices>
Nov 24 10:55:01 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:55:01 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:55:01 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk"/>
Nov 24 10:55:01 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:55:01 user nova-compute[75073]:     </disk>
Nov 24 10:55:01 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:55:01 user nova-compute[75073]:       <mac address="fa:16:3e:eb:8a:c1"/>
Nov 24 10:55:01 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:55:01 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:55:01 user nova-compute[75073]:       <target dev="tap104507a6-5e"/>
Nov 24 10:55:01 user nova-compute[75073]:     </interface>
Nov 24 10:55:01 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:55:01 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/console.log" append="off"/>
Nov 24 10:55:01 user nova-compute[75073]:     </serial>
Nov 24 10:55:01 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:55:01 user nova-compute[75073]:     <video>
Nov 24 10:55:01 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:55:01 user nova-compute[75073]:     </video>
Nov 24 10:55:01 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:55:01 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:55:01 user nova-compute[75073]:     </rng>
Nov 24 10:55:01 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:55:01 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:55:01 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:55:01 user nova-compute[75073]:     </memballoon>
Nov 24 10:55:01 user nova-compute[75073]:   </devices>
Nov 24 10:55:01 user nova-compute[75073]: </domain>
Nov 24 10:55:01 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026393672',display_name='tempest-AttachVolumeNegativeTest-server-1026393672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026393672',id=46,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm+N0jCwnIuSLRfW0j+s2mYfxW7fIR/edsvqL7l57Oys8bcLc9T6h7pu3VBVCQJmuU/aLJ1h6lZ1NNlXJkz7ZGSyEGZRAzjvemzcuWWwVAIYiiUGrxEuhct0rKPC8JTpw==',key_name='tempest-keypair-1105248111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-fzimlxh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=1fa9da72-81b0-4980-9258-3696819e5986,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_vif [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58432d80-2924-55ee-bda4-c1f6d352e876', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:01 user nova-compute[75073]: INFO nova.compute.manager [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attaching volume 1e630ebd-6e01-487c-b138-11d4db231ffb to /dev/vdb
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap104507a6-5e, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap104507a6-5e, col_values=(('qos', UUID('9ee2fd6c-6ad3-472b-90a4-a2f6149aeddc')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap104507a6-5e, col_values=(('external_ids', {'iface-id': '104507a6-5e0f-41f7-8480-20a7719f0ef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:8a:c1', 'vm-uuid': '1fa9da72-81b0-4980-9258-3696819e5986'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:01 user nova-compute[75073]: INFO os_vif [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e')
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.utils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32b992-4e16-4de2-a01b-898aff14644e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[37632e1b-c603-46ef-af7c-df1100f4d3dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:eb:8a:c1, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89cb6e-21e0-4518-a57c-33ba13abdf43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e9090-d642-4fa7-8d80-00ef0a0f1074]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:55:01 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[accb7527-b610-40c9-abbc-2afc712b8257]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG os_brick.utils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating existing volume attachment record: 98d65e8e-ff9f-4897-adaa-a69247d71016 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updated VIF entry in instance network info cache for port 104507a6-5e0f-41f7-8480-20a7719f0ef3. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG nova.network.neutron [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updating instance_info_cache with network_info: [{"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:55:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9a0160f0-c19a-4708-97f4-f198006e5ca4 req-b102b639-e95a-42a5-8ea0-54621a5756c1 service nova] Releasing lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:02 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:55:02 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.212249755859375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 48d3c467-452c-449c-937d-2cae851b2faa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 1fa9da72-81b0-4980-9258-3696819e5986 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] No waiting events found dispatching network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:55:03 user nova-compute[75073]: WARNING nova.compute.manager [req-bab30003-ef99-4e51-9862-34de82bc99ef req-ffd4e1d1-eb5f-4f2b-8eda-628055f17e08 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received unexpected event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 for instance with vm_state building and task_state spawning.
Nov 24 10:55:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:55:05 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Instance spawned successfully.
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] No waiting events found dispatching network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:55:05 user nova-compute[75073]: WARNING nova.compute.manager [req-f1bdd435-27d3-4551-8d10-f851476f3ad5 req-beee45e0-577c-4d9c-9be8-03cb0271681d service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received unexpected event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 for instance with vm_state building and task_state spawning.
Nov 24 10:55:05 user nova-compute[75073]: INFO nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 24 10:55:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:55:05 user nova-compute[75073]: INFO nova.compute.manager [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Took 6.31 seconds to build instance.
Nov 24 10:55:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-d2ceb79a-b6a0-4c10-a0d5-cc362b298db0 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:55:06 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngwmvBEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:55:07 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:55:07 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:55:07 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9247a7-0c31-44a2-baa6-ae612fdab7cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:55:07 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdf6973-95e1-448d-9f61-915deeb084f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb] added
Nov 24 10:55:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9043409-79c0-41da-8e2a-7ab98407f9b2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f9c96-b4fc-4c90-a0c5-5201a45100a5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngwmvBEX {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ngwmvBEX" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3698d3-d547-4728-9b91-a90b38dbe397]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ngwmvBEX'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb0528-cccf-4d56-93e4-f062bfa74226]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f613f1a-33aa-4a34-b66f-fe943a748075]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:07 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:55:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7561509-02c3-47fb-8546-e6b3ceb9d6da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260]
Nov 24 10:55:08 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260] successful.
Nov 24 10:55:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133fc1b-190f-4a76-81ea-03eb8bf094d5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6dbda5-54e2-4f1a-a08a-2c2e2e6248c3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:08 user nova-compute[75073]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)
Nov 24 10:55:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:08 user nova-compute[75073]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)
Nov 24 10:55:08 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b2aaf7-d919-448f-aacd-38a2ad4e72a4]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngwmvBEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:55:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23734626562306438', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734626562306438', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.objects.instance [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:55:09 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:55:09 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:55:09 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:55:09 user nova-compute[75073]:   <serial>1e630ebd-6e01-487c-b138-11d4db231ffb</serial>
Nov 24 10:55:09 user nova-compute[75073]: </disk>
Nov 24 10:55:09 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No VIF found with MAC fa:16:3e:6c:d6:88, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:55:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-1402e43d-e90e-472e-b840-a549e08addae tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.049s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:55:11 user nova-compute[75073]: INFO nova.compute.manager [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Detaching volume 1e630ebd-6e01-487c-b138-11d4db231ffb
Nov 24 10:55:11 user nova-compute[75073]: INFO nova.virt.block_device [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attempting to driver detach volume 1e630ebd-6e01-487c-b138-11d4db231ffb from mountpoint /dev/vdb
Nov 24 10:55:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Attempting to detach device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:55:11 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:55:11 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:55:11 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:55:11 user nova-compute[75073]:   <serial>1e630ebd-6e01-487c-b138-11d4db231ffb</serial>
Nov 24 10:55:11 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:55:11 user nova-compute[75073]: </disk>
Nov 24 10:55:11 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:55:11 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config.
Nov 24 10:55:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:55:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:55:11 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:55:11 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:55:11 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:55:11 user nova-compute[75073]:   <serial>1e630ebd-6e01-487c-b138-11d4db231ffb</serial>
Nov 24 10:55:11 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:55:11 user nova-compute[75073]: </disk>
Nov 24 10:55:11 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:55:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:55:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec is timed out.
Nov 24 10:55:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config.
Nov 24 10:55:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ngwmvBEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:55:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e39f05-0ef9-4c4a-8261-30db8a199243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:55:32 user nova-compute[75073]: No targets found.
Nov 24 10:55:32 user nova-compute[75073]: iSNS:
Nov 24 10:55:32 user nova-compute[75073]: No targets found.
Nov 24 10:55:32 user nova-compute[75073]: STATIC:
Nov 24 10:55:32 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb
Nov 24 10:55:32 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:55:32 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:55:32 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:55:32 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:55:32 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:55:32 user nova-compute[75073]: FIRMWARE:
Nov 24 10:55:32 user nova-compute[75073]: No targets found.
Nov 24 10:55:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:55:32 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:55:32 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7581a42c-1751-4bc0-beca-78e2bb31568b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e4451-1c1b-41ee-b534-ff028cc4d50b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:32 user nova-compute[75073]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)
Nov 24 10:55:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:55:32 user nova-compute[75073]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb (non-flash)
Nov 24 10:55:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238788af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b0f19-d3de-4969-a36b-d7884be4e1c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa356605-4c09-433e-90cb-36bb4f115cb8]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8f782-c8fb-4b2d-bf5c-7637829e7d95]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905d05a-fd7f-44bd-bb87-fbc54de68b9a]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa55998-24cb-4ca6-af01-3a9e1d79e22b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a1bf8-8a11-45db-a54c-6bb88ce0664a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260]
Nov 24 10:55:32 user nova-compute[75073]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb, portal: 172.16.0.220,3260] successful.
Nov 24 10:55:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e630ebd-6e01-487c-b138-11d4db231ffb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c30208-79b1-43ca-bac3-08676c5d61ad]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== disconnect_volume: return (285ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:55:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:55:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0a8d72de-af0e-4892-8ac2-62b49f23cd30 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:55:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:55:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:55:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:55:58 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:55:58 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:56:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:56:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=25.182449340820312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 48d3c467-452c-449c-937d-2cae851b2faa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 1fa9da72-81b0-4980-9258-3696819e5986 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:05 user nova-compute[75073]: INFO nova.compute.manager [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attaching volume ae56c647-925b-4a18-b66b-31a10942075c to /dev/vdb
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.utils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbdc970-1bc1-4492-8c93-7012b3cb1927]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b94b28-c076-4a87-a743-2e557dad7b30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b8738-b662-4c6a-a69a-29eb85138e1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[70350f19-a1a0-4b88-9adb-285526957046]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:56:05 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:56:05 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5448a7d2-b74f-47cc-97cf-4991fbb070b0]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG os_brick.utils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:56:05 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating existing volume attachment record: 517132db-4d08-480f-ac9f-226035a95a22 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:56:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [{"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-0ef3b4a2-5b5b-4103-a218-6596d81309ec" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKYaoPcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:56:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:56:11 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:56:11 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a541cad-3f95-4acd-94dd-ec61a60972bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:56:11 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47caec-8232-47ed-9ad4-e06d614bcfee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c] added
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[371aa845-719f-4feb-a9c7-8ff1859c3bed]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc1a674-5c97-4252-8374-072b206166c1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKYaoPcZ {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKYaoPcZ" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacdca2b-a76d-41e0-a5f9-078b57400231]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xKYaoPcZ'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea75713-621a-41fd-8c5a-654ef41e39aa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8581a6-3514-4c79-b884-b05f8b528ba2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[380fba5d-fef6-4ba1-9d7d-95c962cc86b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260]
Nov 24 10:56:11 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260] successful.
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb75315f-89dc-4d30-aad5-e35a6767fdde]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4a6cb-017c-41c1-a90c-0b03e541f915]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:11 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:11 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:11 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5f7508-233c-4461-8345-b785b230321d]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKYaoPcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23263383038306166', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263383038306166', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:56:12 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:12 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:56:12 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:12 user nova-compute[75073]:   <serial>ae56c647-925b-4a18-b66b-31a10942075c</serial>
Nov 24 10:56:12 user nova-compute[75073]: </disk>
Nov 24 10:56:12 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:56:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:56:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:56:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] No VIF found with MAC fa:16:3e:6c:d6:88, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:56:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-47d47ba4-3482-4ec1-aa45-78118fd8a68d tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.981s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:15 user nova-compute[75073]: INFO nova.compute.manager [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Detaching volume ae56c647-925b-4a18-b66b-31a10942075c
Nov 24 10:56:15 user nova-compute[75073]: INFO nova.virt.block_device [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Attempting to driver detach volume ae56c647-925b-4a18-b66b-31a10942075c from mountpoint /dev/vdb
Nov 24 10:56:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Attempting to detach device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:56:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:56:15 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:15 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:56:15 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:15 user nova-compute[75073]:   <serial>ae56c647-925b-4a18-b66b-31a10942075c</serial>
Nov 24 10:56:15 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:56:15 user nova-compute[75073]: </disk>
Nov 24 10:56:15 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:56:15 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the persistent domain config.
Nov 24 10:56:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:56:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:56:15 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:15 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 10:56:15 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:15 user nova-compute[75073]:   <serial>ae56c647-925b-4a18-b66b-31a10942075c</serial>
Nov 24 10:56:15 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:56:15 user nova-compute[75073]: </disk>
Nov 24 10:56:15 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-changed-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Refreshing instance network info cache due to event network-changed-7007458f-8ce6-4c46-99d5-b4e83edd3d13. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] Acquiring lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] Acquired lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:56:17 user nova-compute[75073]: DEBUG nova.network.neutron [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Refreshing network info cache for port 7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Ignoring supplied device name: /dev/vdb
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:18 user nova-compute[75073]: INFO nova.compute.manager [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Attaching volume 1b2ca1f3-ff14-440b-9992-0e860b407bea to /dev/vdb
Nov 24 10:56:18 user nova-compute[75073]: DEBUG nova.network.neutron [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updated VIF entry in instance network info cache for port 7007458f-8ce6-4c46-99d5-b4e83edd3d13. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG nova.network.neutron [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updating instance_info_cache with network_info: [{"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.utils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7c171475-4e0b-4718-97c8-6a02e0584888 req-354d26e2-6697-43a9-aa9f-7c8bdb873f94 service nova] Releasing lock "refresh_cache-48d3c467-452c-449c-937d-2cae851b2faa" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b22db-8c0c-4db4-b3b3-7f489d51b4cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e6495-3b7d-45be-821d-d2451c977eb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[268bc373-7eea-4dd6-9953-f0d1127e94bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6f6d4-5b26-4cc6-9c82-c58617d07de2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 10:56:18 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 10:56:18 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53253cd-fd9a-4be4-bf8a-2d239486ce6b]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG os_brick.utils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:56:18 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updating existing volume attachment record: a84f3120-90a8-4747-af41-ba651d7d4b15 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 10:56:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAlIKLXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:56:24 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:56:24 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:56:24 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67fb91c-e8d0-468e-aeef-1f01becf4933]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 10:56:24 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e5827-05e0-44de-a343-e2fa378fb1fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea] added
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d49636-e093-483d-a40b-ff8eb9407322]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf891b3-3217-4a17-bd62-5ce2ad64e72a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAlIKLXO {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAlIKLXO" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38dec8c-cbe0-4090-80a0-18cdb456727e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAlIKLXO'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32fb24-e4b0-4420-ac4c-fa2944716cbc]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb7e462-bfd2-4978-8252-ee2b63aeec45]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4b34b-a093-4d23-ab1e-20cc53d3fd87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260]
Nov 24 10:56:24 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260] successful.
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd790d2-1c8e-4491-abca-e45ba0a3e215]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ea3cc0-32e6-44eb-96b2-085ef57ba2a5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:24 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:56:24 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0bcc7-4764-413d-9809-2060d38a8809]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 10:56:24 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAlIKLXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 10:56:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:56:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26361643030383130', 'path': '/dev/sdd'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:56:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361643030383130', 'path': '/dev/sdd'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 10:56:25 user nova-compute[75073]: DEBUG nova.objects.instance [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:25 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 10:56:25 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:25 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:56:25 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:25 user nova-compute[75073]:   <serial>1b2ca1f3-ff14-440b-9992-0e860b407bea</serial>
Nov 24 10:56:25 user nova-compute[75073]: </disk>
Nov 24 10:56:25 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 10:56:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:56:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:56:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] No VIF found with MAC fa:16:3e:e4:3f:bf, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:56:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23e879a4-acf8-467a-96e5-0c66e08c4892 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.877s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Verify base images {{(pid=75073) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Image id 095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604 yields fingerprint b62b8140a1c7c93494f8c511b15107d8e8aadd9b {{(pid=75073) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 24 10:56:29 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] image 095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604 at (/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b): checking
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] image 095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604 at (/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b): image is in use {{(pid=75073) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75073) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 3317d418-538c-43f9-bb99-6f6aa19a2391 is a valid instance name {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 3317d418-538c-43f9-bb99-6f6aa19a2391 has a disk file {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 is backed by b62b8140a1c7c93494f8c511b15107d8e8aadd9b {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 1fa9da72-81b0-4980-9258-3696819e5986 is a valid instance name {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 1fa9da72-81b0-4980-9258-3696819e5986 has a disk file {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 10:56:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 1fa9da72-81b0-4980-9258-3696819e5986 is backed by b62b8140a1c7c93494f8c511b15107d8e8aadd9b {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 48d3c467-452c-449c-937d-2cae851b2faa is a valid instance name {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 48d3c467-452c-449c-937d-2cae851b2faa has a disk file {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 48d3c467-452c-449c-937d-2cae851b2faa is backed by b62b8140a1c7c93494f8c511b15107d8e8aadd9b {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 0ef3b4a2-5b5b-4103-a218-6596d81309ec is a valid instance name {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] 0ef3b4a2-5b5b-4103-a218-6596d81309ec has a disk file {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec is backed by b62b8140a1c7c93494f8c511b15107d8e8aadd9b {{(pid=75073) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40
Nov 24 10:56:30 user nova-compute[75073]: WARNING nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Active base files: /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Removable base files: /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54 /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128 /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01 /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40 /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4970810ccdb93c94b94f34f4c36e5f82411a5b54
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7cb7c6189fdf4ebbe344eb5704b9e071c06e128
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6ae3aad17a6b56f242b579cc7ea05c0904522e01
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f7b58c8f751d47a8919e83664132ecb253a179c
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ecbcaf7cfcc10ee60adfd8a315f561577728a40
Nov 24 10:56:30 user nova-compute[75073]: INFO nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6eb48bd884d42d907d54458744340d4ade110a90
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Verification complete {{(pid=75073) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Verify swap images {{(pid=75073) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 24 10:56:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.imagecache [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Verify ephemeral images {{(pid=75073) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 24 10:56:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec is timed out.
Nov 24 10:56:36 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully detached device vdb from instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec from the live domain config.
Nov 24 10:56:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKYaoPcZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:56:36 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dba919-ff9c-47c3-97cf-dde77c5421cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:56:36 user nova-compute[75073]: No targets found.
Nov 24 10:56:36 user nova-compute[75073]: iSNS:
Nov 24 10:56:36 user nova-compute[75073]: No targets found.
Nov 24 10:56:36 user nova-compute[75073]: STATIC:
Nov 24 10:56:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea
Nov 24 10:56:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:56:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:56:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:56:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:56:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:56:36 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c
Nov 24 10:56:36 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:56:36 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:56:36 user nova-compute[75073]: FIRMWARE:
Nov 24 10:56:36 user nova-compute[75073]: No targets found.
Nov 24 10:56:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:56:36 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:56:36 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63e80d-90a7-44a0-9570-36e5167c5ecf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef7de5-5295-4156-b6ab-f14874d0a132]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:36 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:36 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:56:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:56:36 user nova-compute[75073]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c (non-flash)
Nov 24 10:56:36 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:56:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb238478c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7457f-1449-48b6-a6d8-4be12f8666f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a964bd0-4ba0-422c-87af-75e2eefb91dc]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec63f6-ec27-4278-b88c-143326156bb7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c6ca0-21d4-42b3-a43b-15031ff962d7]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b85a3-3f76-41ea-8ee6-19e891ac39f9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d056a3-539e-4abc-b84a-9fd55f8f09b2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260]
Nov 24 10:56:36 user nova-compute[75073]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c, portal: 172.16.0.220,3260] successful.
Nov 24 10:56:36 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae56c647-925b-4a18-b66b-31a10942075c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af28d69-6c34-4e7d-9ef0-525ef52e1e7a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] <== disconnect_volume: return (295ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:56:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:37 user nova-compute[75073]: DEBUG nova.objects.instance [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'flavor' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-23f51a41-63b4-4e01-af11-7f7d10c88c20 tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:43 user nova-compute[75073]: INFO nova.compute.manager [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Detaching volume 1b2ca1f3-ff14-440b-9992-0e860b407bea
Nov 24 10:56:43 user nova-compute[75073]: INFO nova.virt.block_device [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Attempting to driver detach volume 1b2ca1f3-ff14-440b-9992-0e860b407bea from mountpoint /dev/vdb
Nov 24 10:56:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Attempting to detach device vdb from instance 48d3c467-452c-449c-937d-2cae851b2faa from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:56:43 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:43 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:56:43 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:43 user nova-compute[75073]:   <serial>1b2ca1f3-ff14-440b-9992-0e860b407bea</serial>
Nov 24 10:56:43 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:56:43 user nova-compute[75073]: </disk>
Nov 24 10:56:43 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:56:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully detached device vdb from instance 48d3c467-452c-449c-937d-2cae851b2faa from the persistent domain config.
Nov 24 10:56:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48d3c467-452c-449c-937d-2cae851b2faa from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:56:43 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:56:43 user nova-compute[75073]:   <source dev="/dev/sdd"/>
Nov 24 10:56:43 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:56:43 user nova-compute[75073]:   <serial>1b2ca1f3-ff14-440b-9992-0e860b407bea</serial>
Nov 24 10:56:43 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:56:43 user nova-compute[75073]: </disk>
Nov 24 10:56:43 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:56:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-changed-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Refreshing instance network info cache due to event network-changed-104507a6-5e0f-41f7-8480-20a7719f0ef3. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] Acquiring lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] Acquired lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Refreshing network info cache for port 104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updated VIF entry in instance network info cache for port 104507a6-5e0f-41f7-8480-20a7719f0ef3. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.network.neutron [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updating instance_info_cache with network_info: [{"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:50 user nova-compute[75073]: INFO nova.compute.manager [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Terminating instance
Nov 24 10:56:50 user nova-compute[75073]: DEBUG nova.compute.manager [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-564d6dd6-fc43-45a3-a2a0-2466624af890 req-ba475fb4-d044-40d5-ae1f-f120903a244f service nova] Releasing lock "refresh_cache-1fa9da72-81b0-4980-9258-3696819e5986" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Instance destroyed successfully.
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'resources' on Instance uuid 1fa9da72-81b0-4980-9258-3696819e5986 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026393672',display_name='tempest-AttachVolumeNegativeTest-server-1026393672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026393672',id=46,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm+N0jCwnIuSLRfW0j+s2mYfxW7fIR/edsvqL7l57Oys8bcLc9T6h7pu3VBVCQJmuU/aLJ1h6lZ1NNlXJkz7ZGSyEGZRAzjvemzcuWWwVAIYiiUGrxEuhct0rKPC8JTpw==',key_name='tempest-keypair-1105248111',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-fzimlxh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:55:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=1fa9da72-81b0-4980-9258-3696819e5986,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "address": "fa:16:3e:eb:8a:c1", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104507a6-5e", "ovs_interfaceid": "104507a6-5e0f-41f7-8480-20a7719f0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG os_vif [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap104507a6-5e, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ee2fd6c-6ad3-472b-90a4-a2f6149aeddc) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:51 user nova-compute[75073]: INFO os_vif [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:8a:c1,bridge_name='br-int',has_traffic_filtering=True,id=104507a6-5e0f-41f7-8480-20a7719f0ef3,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104507a6-5e')
Nov 24 10:56:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Deleting instance files /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986_del
Nov 24 10:56:51 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Deletion of /opt/stack/data/nova/instances/1fa9da72-81b0-4980-9258-3696819e5986_del complete
Nov 24 10:56:51 user nova-compute[75073]: INFO nova.compute.manager [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 24 10:56:51 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:56:51 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:56:52 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Took 0.69 seconds to deallocate network for instance.
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-901e1f69-4dec-41da-9cb6-96908bb6ae23 req-0fdd37ec-4a53-4980-b104-7a3b9e6dd190 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-deleted-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:56:52 user nova-compute[75073]: INFO nova.compute.manager [req-901e1f69-4dec-41da-9cb6-96908bb6ae23 req-0fdd37ec-4a53-4980-b104-7a3b9e6dd190 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Neutron deleted interface 104507a6-5e0f-41f7-8480-20a7719f0ef3; detaching it from the instance and deleting it from the info cache
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.network.neutron [req-901e1f69-4dec-41da-9cb6-96908bb6ae23 req-0fdd37ec-4a53-4980-b104-7a3b9e6dd190 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-901e1f69-4dec-41da-9cb6-96908bb6ae23 req-0fdd37ec-4a53-4980-b104-7a3b9e6dd190 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Detach interface failed, port_id=104507a6-5e0f-41f7-8480-20a7719f0ef3, reason: Instance 1fa9da72-81b0-4980-9258-3696819e5986 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-unplugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] No waiting events found dispatching network-vif-unplugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-unplugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Acquiring lock "1fa9da72-81b0-4980-9258-3696819e5986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] Lock "1fa9da72-81b0-4980-9258-3696819e5986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] No waiting events found dispatching network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:56:52 user nova-compute[75073]: WARNING nova.compute.manager [req-6b446694-1107-4878-9fe9-108cf3ab730d req-297fab18-dd4f-41cb-94c8-b9072e34f365 service nova] [instance: 1fa9da72-81b0-4980-9258-3696819e5986] Received unexpected event network-vif-plugged-104507a6-5e0f-41f7-8480-20a7719f0ef3 for instance with vm_state active and task_state deleting.
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:52 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Deleted allocations for instance 1fa9da72-81b0-4980-9258-3696819e5986
Nov 24 10:56:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-4bfa24ab-9bc0-48a6-a17c-fafa4215d1d1 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "1fa9da72-81b0-4980-9258-3696819e5986" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:56:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:56:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:57:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:57:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48d3c467-452c-449c-937d-2cae851b2faa is timed out.
Nov 24 10:57:03 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully detached device vdb from instance 48d3c467-452c-449c-937d-2cae851b2faa from the live domain config.
Nov 24 10:57:03 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAlIKLXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:57:03 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2e6523-5359-417c-afe4-cc6c107c58fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:57:03 user nova-compute[75073]: No targets found.
Nov 24 10:57:03 user nova-compute[75073]: iSNS:
Nov 24 10:57:03 user nova-compute[75073]: No targets found.
Nov 24 10:57:03 user nova-compute[75073]: STATIC:
Nov 24 10:57:03 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea
Nov 24 10:57:03 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:57:03 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:57:03 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:57:03 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:57:03 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:57:03 user nova-compute[75073]: FIRMWARE:
Nov 24 10:57:03 user nova-compute[75073]: No targets found.
Nov 24 10:57:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:57:03 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:57:03 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da83fcd-8e26-4cdd-927d-d8de24f8fd65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8db3d4-e8d0-4b10-9903-5f236555c669]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:57:03 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:57:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:57:03 user nova-compute[75073]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea (non-flash)
Nov 24 10:57:03 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb240268550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea'): ({'sdd'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Removing single pathed devices sdd {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7d265c-1edd-4af8-9504-a1a71e6376c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3552dbd-d9d1-4ee7-8e79-a70e751b56cd]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Flushing IO for device /dev/sdd {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[035481ea-a857-4b5c-95a9-50cbbf4b22cd]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:57:03 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba94176-d7d1-4255-a866-e4d3096cce1c]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] SCSI volumes sdd have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:57:04 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.208580017089844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d17c6-fb57-4136-a396-af4a5c6b4828]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fd2d9-2c63-4e4b-a0c4-51b5437fd8bc]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260]
Nov 24 10:57:04 user nova-compute[75073]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea, portal: 172.16.0.220,3260] successful.
Nov 24 10:57:04 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad633142-ce8c-43d5-a75a-3749a6e08090]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.679s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== disconnect_volume: return (680ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 48d3c467-452c-449c-937d-2cae851b2faa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:57:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG nova.objects.instance [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'flavor' on Instance uuid 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-0905eca3-7797-48c3-8541-97aafd3ceb90 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.152s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.039s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:05 user nova-compute[75073]: INFO nova.compute.manager [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Terminating instance
Nov 24 10:57:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-unplugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] No waiting events found dispatching network-vif-unplugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:57:05 user nova-compute[75073]: DEBUG nova.compute.manager [req-28756c75-a501-401c-b64f-af7c5e6e0440 req-3f7977c9-f415-48cb-8ee4-bab8e658b7cb service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-unplugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:57:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Instance destroyed successfully.
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lazy-loading 'resources' on Instance uuid 48d3c467-452c-449c-937d-2cae851b2faa {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642840068',display_name='tempest-VolumesSnapshotTestJSON-instance-642840068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642840068',id=45,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbypwf/w7DjwvtCEZrDFVS2w20XIRR7yqkno430+XPqWxFNebJ3oe782sgbWY8Vn1Lx+rf9nVbbMj2ces+FASKsLsG9LNk3gS+kSTeGzA3eNhkZWatyqI8JdDgwqCz3eg==',key_name='tempest-keypair-1753458590',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:54:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20fa8e30e8443a391b5ac10de5a84e5',ramdisk_id='',reservation_id='r-fyhgkjiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1276131083',owner_user_name='tempest-VolumesSnapshotTestJSON-1276131083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='219e480168c642a5b52cf36552dd708b',uuid=48d3c467-452c-449c-937d-2cae851b2faa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converting VIF {"id": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "address": "fa:16:3e:e4:3f:bf", "network": {"id": "99d4986d-b325-4519-b6e3-ec95b8acf269", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-129771915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20fa8e30e8443a391b5ac10de5a84e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007458f-8c", "ovs_interfaceid": "7007458f-8ce6-4c46-99d5-b4e83edd3d13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_vif [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7007458f-8c, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e9a3fd2-5494-4f18-8899-bb591d10f07e) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:06 user nova-compute[75073]: INFO os_vif [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:3f:bf,bridge_name='br-int',has_traffic_filtering=True,id=7007458f-8ce6-4c46-99d5-b4e83edd3d13,network=Network(99d4986d-b325-4519-b6e3-ec95b8acf269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007458f-8c')
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAlIKLXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:57:06 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[311138e5-9378-414b-96c1-a3f5c5e27c49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:57:06 user nova-compute[75073]: No targets found.
Nov 24 10:57:06 user nova-compute[75073]: iSNS:
Nov 24 10:57:06 user nova-compute[75073]: No targets found.
Nov 24 10:57:06 user nova-compute[75073]: STATIC:
Nov 24 10:57:06 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:57:06 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:57:06 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:57:06 user nova-compute[75073]: FIRMWARE:
Nov 24 10:57:06 user nova-compute[75073]: No targets found.
Nov 24 10:57:06 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:57:06 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:57:06 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b2ca1f3-ff14-440b-9992-0e860b407bea', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1efa1f-bd70-46e6-9848-de827c74aaf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ff600-1828-4271-8935-c7046105a84e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:57:06 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:57:06 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb240268040>, {}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Disconnecting from: [] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] <== disconnect_volume: return (68ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:57:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Deleting instance files /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa_del
Nov 24 10:57:06 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Deletion of /opt/stack/data/nova/instances/48d3c467-452c-449c-937d-2cae851b2faa_del complete
Nov 24 10:57:06 user nova-compute[75073]: INFO nova.compute.manager [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:57:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:57:07 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Took 0.80 seconds to deallocate network for instance.
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-cb6ca769-4948-4598-9db5-839640bd0dc7 req-e94cc87b-20c3-4eb7-9347-d791537f3936 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-deleted-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:07 user nova-compute[75073]: WARNING nova.volume.cinder [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Attachment a84f3120-90a8-4747-af41-ba651d7d4b15 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a84f3120-90a8-4747-af41-ba651d7d4b15. (HTTP 404) (Request-ID: req-e1c8a8bc-42b7-4330-a127-80dd5173389b)
Nov 24 10:57:07 user nova-compute[75073]: INFO nova.compute.manager [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Took 0.02 seconds to detach 1 volumes for instance.
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:07 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Deleted allocations for instance 48d3c467-452c-449c-937d-2cae851b2faa
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a8ca6357-7029-4fb4-acfc-db4fa7f16119 tempest-VolumesSnapshotTestJSON-1276131083 tempest-VolumesSnapshotTestJSON-1276131083-project-member] Lock "48d3c467-452c-449c-937d-2cae851b2faa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] Acquiring lock "48d3c467-452c-449c-937d-2cae851b2faa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] Lock "48d3c467-452c-449c-937d-2cae851b2faa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] No waiting events found dispatching network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:57:07 user nova-compute[75073]: WARNING nova.compute.manager [req-e202756e-a67b-41d1-af64-63942527aace req-c99f5341-8ce9-4cc5-9126-ce26d9b03d13 service nova] [instance: 48d3c467-452c-449c-937d-2cae851b2faa] Received unexpected event network-vif-plugged-7007458f-8ce6-4c46-99d5-b4e83edd3d13 for instance with vm_state deleted and task_state None.
Nov 24 10:57:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:57:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:57:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:57:08 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:57:09 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [{"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:57:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-3317d418-538c-43f9-bb99-6f6aa19a2391" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:57:09 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:57:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 10:57:11 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 10:57:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 10:57:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:57:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:28 user nova-compute[75073]: INFO nova.compute.manager [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Terminating instance
Nov 24 10:57:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-unplugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] No waiting events found dispatching network-vif-unplugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-fc312eeb-8733-4af4-97a9-fb89e191955b req-3aabe597-ef9f-4103-94ff-42ef7c4d6388 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-unplugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:57:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Instance destroyed successfully.
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lazy-loading 'resources' on Instance uuid 0ef3b4a2-5b5b-4103-a218-6596d81309ec {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:50:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2074451984',display_name='tempest-SnapshotDataIntegrityTests-server-2074451984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2074451984',id=42,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDubqhBDlqoYhfNhC4N5ZW5kv0Tk+zdWgq9hMmHTZofE/aVgB+O5YCMbXw60eOIhz81VidufFDSvHb9LlnloQZFaPnuXp5UfVm0uggz5mkqsxmzKlhnc6qWlXRFP9yu4dw==',key_name='tempest-keypair-564483353',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ba4e5720bb41388d3f3a3af5c9f8c0',ramdisk_id='',reservation_id='r-3dhz2vtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1751718283',owner_user_name='tempest-SnapshotDataIntegrityTests-1751718283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef13ee0365340eab76be49b157992b1',uuid=0ef3b4a2-5b5b-4103-a218-6596d81309ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converting VIF {"id": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "address": "fa:16:3e:6c:d6:88", "network": {"id": "f46aa61d-8e93-447c-bd4c-01c1d84ff041", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1049516434-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ba4e5720bb41388d3f3a3af5c9f8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63838b8a-de", "ovs_interfaceid": "63838b8a-de1f-4c98-8427-c4fbc7af10ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG os_vif [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63838b8a-de, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6996fd6-dab7-4eee-9d8d-0992a02f82ca) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:29 user nova-compute[75073]: INFO os_vif [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d6:88,bridge_name='br-int',has_traffic_filtering=True,id=63838b8a-de1f-4c98-8427-c4fbc7af10ea,network=Network(f46aa61d-8e93-447c-bd4c-01c1d84ff041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63838b8a-de')
Nov 24 10:57:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Deleting instance files /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec_del
Nov 24 10:57:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Deletion of /opt/stack/data/nova/instances/0ef3b4a2-5b5b-4103-a218-6596d81309ec_del complete
Nov 24 10:57:29 user nova-compute[75073]: INFO nova.compute.manager [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 24 10:57:29 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:57:29 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:57:30 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:57:30 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Took 0.70 seconds to deallocate network for instance.
Nov 24 10:57:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:30 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:57:30 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:57:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:30 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Deleted allocations for instance 0ef3b4a2-5b5b-4103-a218-6596d81309ec
Nov 24 10:57:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-38251f51-dfe2-47db-b7cb-c6a9585e785b tempest-SnapshotDataIntegrityTests-1751718283 tempest-SnapshotDataIntegrityTests-1751718283-project-member] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] Acquiring lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] Lock "0ef3b4a2-5b5b-4103-a218-6596d81309ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:57:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] No waiting events found dispatching network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:57:31 user nova-compute[75073]: WARNING nova.compute.manager [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received unexpected event network-vif-plugged-63838b8a-de1f-4c98-8427-c4fbc7af10ea for instance with vm_state deleted and task_state None.
Nov 24 10:57:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-f699fe96-426a-4e59-9e7d-ddd727a3e68b req-55b0f47e-d4c1-4405-8f2e-7574d0c59c28 service nova] [instance: 0ef3b4a2-5b5b-4103-a218-6596d81309ec] Received event network-vif-deleted-63838b8a-de1f-4c98-8427-c4fbc7af10ea {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:57:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:57:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:57:41 user nova-compute[75073]: INFO nova.compute.manager [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Detaching volume f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:57:41 user nova-compute[75073]: INFO nova.virt.block_device [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Attempting to driver detach volume f52e32cc-0c13-465b-aab9-b8a1eb5e107e from mountpoint /dev/vdb
Nov 24 10:57:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Attempting to detach device vdb from instance 3317d418-538c-43f9-bb99-6f6aa19a2391 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 10:57:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:57:42 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:57:42 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:57:42 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:57:42 user nova-compute[75073]:   <serial>f52e32cc-0c13-465b-aab9-b8a1eb5e107e</serial>
Nov 24 10:57:42 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:57:42 user nova-compute[75073]: </disk>
Nov 24 10:57:42 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:57:42 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance 3317d418-538c-43f9-bb99-6f6aa19a2391 from the persistent domain config.
Nov 24 10:57:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3317d418-538c-43f9-bb99-6f6aa19a2391 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 10:57:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 10:57:42 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 10:57:42 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 10:57:42 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 10:57:42 user nova-compute[75073]:   <serial>f52e32cc-0c13-465b-aab9-b8a1eb5e107e</serial>
Nov 24 10:57:42 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 10:57:42 user nova-compute[75073]: </disk>
Nov 24 10:57:42 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 10:57:42 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:57:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:57:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:00 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:00 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:58:02 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3317d418-538c-43f9-bb99-6f6aa19a2391 is timed out.
Nov 24 10:58:02 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance 3317d418-538c-43f9-bb99-6f6aa19a2391 from the live domain config.
Nov 24 10:58:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahFwMiQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 10:58:02 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12ec2d-74d0-4470-a517-bddb7f88a18e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 10:58:02 user nova-compute[75073]: No targets found.
Nov 24 10:58:02 user nova-compute[75073]: iSNS:
Nov 24 10:58:02 user nova-compute[75073]: No targets found.
Nov 24 10:58:02 user nova-compute[75073]: STATIC:
Nov 24 10:58:02 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e
Nov 24 10:58:02 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 10:58:02 user nova-compute[75073]:                 Iface Name: default
Nov 24 10:58:02 user nova-compute[75073]: FIRMWARE:
Nov 24 10:58:02 user nova-compute[75073]: No targets found.
Nov 24 10:58:02 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 10:58:02 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 10:58:02 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04754e-1acc-4050-9e26-51e36ed1d241]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc01ea-c81f-4f98-9eb3-79d4db3de8e3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:58:02 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e (non-flash)
Nov 24 10:58:02 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382009d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[376495a1-c506-4775-9ca1-a9f161c9af27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2762ac-bec8-437a-90d2-add8d0d0868f]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402f362-6cf8-4673-849b-babb57e3e02d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc889874-d2d1-4bb3-a780-be466d8bb953]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9168a61-f87d-44d4-a748-f3b858bea254]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7983f85e-976b-4a5c-a02d-91824e82ef08]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260]
Nov 24 10:58:02 user nova-compute[75073]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e, portal: 172.16.0.220,3260] successful.
Nov 24 10:58:02 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f52e32cc-0c13-465b-aab9-b8a1eb5e107e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb3de56-3eea-467a-a488-07fe3a0f9913]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== disconnect_volume: return (292ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 10:58:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 10:58:03 user nova-compute[75073]: DEBUG nova.objects.instance [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:58:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-2b95a58b-87c7-433c-a9df-47ad4cb78b4f tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.710s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:58:04 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:05 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:58:05 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.262420654296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 3317d418-538c-43f9-bb99-6f6aa19a2391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:58:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:58:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 10:58:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:11 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:58:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:58:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 10:58:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:32 user nova-compute[75073]: INFO nova.compute.manager [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Terminating instance
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-unplugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] No waiting events found dispatching network-vif-unplugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-9c88773b-fcce-4341-b52f-0d0de01e44a7 req-3a68c77f-b73c-4dc9-adda-3ecdd92a9e1b service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-unplugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Instance destroyed successfully.
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'resources' on Instance uuid 3317d418-538c-43f9-bb99-6f6aa19a2391 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109475389',display_name='tempest-AttachVolumeNegativeTest-server-109475389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109475389',id=44,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHQHXfOVK6tMCnvYiPs8ewdtiBb4CyIa8ejAUyDBBrlzpmc+5biEV22KeZJzI3XMwrrClITh3+LRXiJCIuumnHwbvGlf/JnOsBVvfXE0i1Iy5rWClS9Ln12D5Xq6pTYCA==',key_name='tempest-keypair-1831016798',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-x0094jis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=3317d418-538c-43f9-bb99-6f6aa19a2391,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "address": "fa:16:3e:7a:8a:6f", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e40ca5-ef", "ovs_interfaceid": "03e40ca5-ef21-4a1a-a3a1-756b8cb99e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG os_vif [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03e40ca5-ef, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c8d4f26-d7fe-4ecd-853a-e654cf1adb3a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:32 user nova-compute[75073]: INFO os_vif [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8a:6f,bridge_name='br-int',has_traffic_filtering=True,id=03e40ca5-ef21-4a1a-a3a1-756b8cb99e02,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e40ca5-ef')
Nov 24 10:58:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Deleting instance files /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391_del
Nov 24 10:58:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Deletion of /opt/stack/data/nova/instances/3317d418-538c-43f9-bb99-6f6aa19a2391_del complete
Nov 24 10:58:33 user nova-compute[75073]: INFO nova.compute.manager [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:58:33 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Took 0.84 seconds to deallocate network for instance.
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.095s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:58:34 user nova-compute[75073]: INFO nova.compute.claims [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Claim successful on node user
Nov 24 10:58:34 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Deleted allocations for instance 3317d418-538c-43f9-bb99-6f6aa19a2391
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32bc21c5-71db-48a6-9512-9e68025360e7 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:58:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.policy [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1d0ef3a4874771b1690ab4cd97fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdb3d4520f44e084e0342e282bf315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:58:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Creating image(s)
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "f5b3b473636ebdf6f21c44f3074475a992725e10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "f5b3b473636ebdf6f21c44f3074475a992725e10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] Acquiring lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] Lock "3317d418-538c-43f9-bb99-6f6aa19a2391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] No waiting events found dispatching network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:58:35 user nova-compute[75073]: WARNING nova.compute.manager [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received unexpected event network-vif-plugged-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 for instance with vm_state deleted and task_state None.
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-7f1816b6-7b54-4700-b43e-ab3b22dfa68c req-a76bc879-b9c4-4f6b-8c0f-5455d52782e3 service nova] [instance: 3317d418-538c-43f9-bb99-6f6aa19a2391] Received event network-vif-deleted-03e40ca5-ef21-4a1a-a3a1-756b8cb99e02 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.virt.images [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] b9fbaea6-b26a-4afa-adca-ec1767f01242 was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.part /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Successfully created port: db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.part /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.converted" returned: 0 in 0.316s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "f5b3b473636ebdf6f21c44f3074475a992725e10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.298s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "f5b3b473636ebdf6f21c44f3074475a992725e10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "f5b3b473636ebdf6f21c44f3074475a992725e10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Successfully updated port: db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json" returned: 0 in 0.182s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10,backing_fmt=raw /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10,backing_fmt=raw /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk 1073741824" returned: 0 in 0.046s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "f5b3b473636ebdf6f21c44f3074475a992725e10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance network_info: |[{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json" returned: 0 in 0.187s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Cannot resize image /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Ensure instance console log exists: /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start _get_guest_xml network_info=[{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:58:31Z,direct_url=<?>,disk_format='qcow2',id=b9fbaea6-b26a-4afa-adca-ec1767f01242,min_disk=0,min_ram=0,name='tempest-scenario-img--101729990',owner='c6bdb3d4520f44e084e0342e282bf315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:58:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': 'b9fbaea6-b26a-4afa-adca-ec1767f01242'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:58:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:58:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:58:31Z,direct_url=<?>,disk_format='qcow2',id=b9fbaea6-b26a-4afa-adca-ec1767f01242,min_disk=0,min_ram=0,name='tempest-scenario-img--101729990',owner='c6bdb3d4520f44e084e0342e282bf315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:58:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:58:34Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'pci_devices' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:58:36 user nova-compute[75073]:   <uuid>cc56f3d9-25f4-449d-9e65-9d239973c02d</uuid>
Nov 24 10:58:36 user nova-compute[75073]:   <name>instance-0000002f</name>
Nov 24 10:58:36 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:58:36 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:58:36 user nova-compute[75073]:   <metadata>
Nov 24 10:58:36 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:58:36 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:name>tempest-TestMinimumBasicScenario-server-1851781203</nova:name>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:58:36</nova:creationTime>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:58:36 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:58:36 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:owner>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:user uuid="fe1d0ef3a4874771b1690ab4cd97fc2f">tempest-TestMinimumBasicScenario-1164257136-project-member</nova:user>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:project uuid="c6bdb3d4520f44e084e0342e282bf315">tempest-TestMinimumBasicScenario-1164257136</nova:project>
Nov 24 10:58:36 user nova-compute[75073]:       </nova:owner>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:root type="image" uuid="b9fbaea6-b26a-4afa-adca-ec1767f01242"/>
Nov 24 10:58:36 user nova-compute[75073]:       <nova:ports>
Nov 24 10:58:36 user nova-compute[75073]:         <nova:port uuid="db0c5c77-e0b6-4a00-9470-f6a72b435564">
Nov 24 10:58:36 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 10:58:36 user nova-compute[75073]:         </nova:port>
Nov 24 10:58:36 user nova-compute[75073]:       </nova:ports>
Nov 24 10:58:36 user nova-compute[75073]:     </nova:instance>
Nov 24 10:58:36 user nova-compute[75073]:   </metadata>
Nov 24 10:58:36 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:58:36 user nova-compute[75073]:     <system>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="serial">cc56f3d9-25f4-449d-9e65-9d239973c02d</entry>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="uuid">cc56f3d9-25f4-449d-9e65-9d239973c02d</entry>
Nov 24 10:58:36 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:58:36 user nova-compute[75073]:     </system>
Nov 24 10:58:36 user nova-compute[75073]:   </sysinfo>
Nov 24 10:58:36 user nova-compute[75073]:   <os>
Nov 24 10:58:36 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:58:36 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:58:36 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:58:36 user nova-compute[75073]:   </os>
Nov 24 10:58:36 user nova-compute[75073]:   <features>
Nov 24 10:58:36 user nova-compute[75073]:     <acpi/>
Nov 24 10:58:36 user nova-compute[75073]:     <apic/>
Nov 24 10:58:36 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:58:36 user nova-compute[75073]:   </features>
Nov 24 10:58:36 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:58:36 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:58:36 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:58:36 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:58:36 user nova-compute[75073]:   </clock>
Nov 24 10:58:36 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:58:36 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:58:36 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:58:36 user nova-compute[75073]:   </cpu>
Nov 24 10:58:36 user nova-compute[75073]:   <devices>
Nov 24 10:58:36 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:58:36 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:58:36 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk"/>
Nov 24 10:58:36 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:58:36 user nova-compute[75073]:     </disk>
Nov 24 10:58:36 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:58:36 user nova-compute[75073]:       <mac address="fa:16:3e:06:d2:e6"/>
Nov 24 10:58:36 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:58:36 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:58:36 user nova-compute[75073]:       <target dev="tapdb0c5c77-e0"/>
Nov 24 10:58:36 user nova-compute[75073]:     </interface>
Nov 24 10:58:36 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:58:36 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/console.log" append="off"/>
Nov 24 10:58:36 user nova-compute[75073]:     </serial>
Nov 24 10:58:36 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:58:36 user nova-compute[75073]:     <video>
Nov 24 10:58:36 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:58:36 user nova-compute[75073]:     </video>
Nov 24 10:58:36 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:58:36 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:58:36 user nova-compute[75073]:     </rng>
Nov 24 10:58:36 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:58:36 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:58:36 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:58:36 user nova-compute[75073]:     </memballoon>
Nov 24 10:58:36 user nova-compute[75073]:   </devices>
Nov 24 10:58:36 user nova-compute[75073]: </domain>
Nov 24 10:58:36 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:58:34Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG os_vif [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '963440c9-7871-5018-8da1-a9d34f5c1dbb', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb0c5c77-e0, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb0c5c77-e0, col_values=(('qos', UUID('f240fc3e-0232-45a8-b075-4129c82eb190')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb0c5c77-e0, col_values=(('external_ids', {'iface-id': 'db0c5c77-e0b6-4a00-9470-f6a72b435564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:d2:e6', 'vm-uuid': 'cc56f3d9-25f4-449d-9e65-9d239973c02d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing instance network info cache due to event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.network.neutron [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:36 user nova-compute[75073]: INFO os_vif [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0')
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:58:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No VIF found with MAC fa:16:3e:06:d2:e6, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:58:37 user nova-compute[75073]: DEBUG nova.network.neutron [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated VIF entry in instance network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:58:37 user nova-compute[75073]: DEBUG nova.network.neutron [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:58:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b391f17e-073a-437a-8206-ab875e0b3c5d req-8632976f-d3a6-4db0-b583-2b05bd44d589 service nova] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:58:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:58:38 user nova-compute[75073]: WARNING nova.compute.manager [req-47eaf331-2ba2-4126-ba5a-1c7f5cc93394 req-2a057898-ab0e-4bb9-be00-494947aadb8b service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state building and task_state spawning.
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:58:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance spawned successfully.
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:58:40 user nova-compute[75073]: INFO nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:58:40 user nova-compute[75073]: WARNING nova.compute.manager [req-3ad7cb09-5764-4f57-b1ff-d0c025a4a5a4 req-8cd11e51-0597-4e9e-847e-7fabd644c241 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state building and task_state spawning.
Nov 24 10:58:40 user nova-compute[75073]: INFO nova.compute.manager [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Took 6.41 seconds to build instance.
Nov 24 10:58:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-94a00951-5e55-49cb-b0c4-149ed6ec09bd tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.504s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:58:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:58:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:58:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 10:59:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:04 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 10:59:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:59:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=25.190486907958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance cc56f3d9-25f4-449d-9e65-9d239973c02d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 10:59:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:59:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:13 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:59:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:59:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 10:59:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 10:59:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 10:59:25 user nova-compute[75073]: INFO nova.compute.claims [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Claim successful on node user
Nov 24 10:59:25 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 10:59:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.policy [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016b326ea3eb4679a05c71c8ebd74763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156576cab144c73be55e1acc81af148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 10:59:26 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Creating image(s)
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.195s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk 1073741824" returned: 0 in 0.053s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Successfully created port: 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Cannot resize image /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Ensure instance console log exists: /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Successfully updated port: 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquired lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-changed-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Refreshing instance network info cache due to event network-changed-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] Acquiring lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating instance_info_cache with network_info: [{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Releasing lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Instance network_info: |[{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] Acquired lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.network.neutron [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Refreshing network info cache for port 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 10:59:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Start _get_guest_xml network_info=[{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 10:59:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:59:27 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342651728',display_name='tempest-AttachVolumeNegativeTest-server-342651728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342651728',id=48,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtvkUbzh/hWdZcAvdMdB6wrpctteiSmyvqFA6mqqPc+j0uac/bpKXs0tcPqWYNsVUWhBVn1FmvyNzXj181iG1w9EFp+9DcNteEYE/mUfoxbrc2h+Wg6I7/v6RI6rw6ZuQ==',key_name='tempest-keypair-1724146043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-k5zpfux7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=f5cfaad7-08ef-4b76-b35c-cee371307851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'pci_devices' on Instance uuid f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] End _get_guest_xml xml=<domain type="kvm">
Nov 24 10:59:28 user nova-compute[75073]:   <uuid>f5cfaad7-08ef-4b76-b35c-cee371307851</uuid>
Nov 24 10:59:28 user nova-compute[75073]:   <name>instance-00000030</name>
Nov 24 10:59:28 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 10:59:28 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 10:59:28 user nova-compute[75073]:   <metadata>
Nov 24 10:59:28 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 10:59:28 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeNegativeTest-server-342651728</nova:name>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:creationTime>2023-11-24 10:59:27</nova:creationTime>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 10:59:28 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 10:59:28 user nova-compute[75073]:       </nova:flavor>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:owner>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:user uuid="016b326ea3eb4679a05c71c8ebd74763">tempest-AttachVolumeNegativeTest-323602591-project-member</nova:user>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:project uuid="d156576cab144c73be55e1acc81af148">tempest-AttachVolumeNegativeTest-323602591</nova:project>
Nov 24 10:59:28 user nova-compute[75073]:       </nova:owner>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 10:59:28 user nova-compute[75073]:       <nova:ports>
Nov 24 10:59:28 user nova-compute[75073]:         <nova:port uuid="6c4a91ca-e83c-4f91-82ec-e49e8d74fb51">
Nov 24 10:59:28 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 10:59:28 user nova-compute[75073]:         </nova:port>
Nov 24 10:59:28 user nova-compute[75073]:       </nova:ports>
Nov 24 10:59:28 user nova-compute[75073]:     </nova:instance>
Nov 24 10:59:28 user nova-compute[75073]:   </metadata>
Nov 24 10:59:28 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 10:59:28 user nova-compute[75073]:     <system>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="serial">f5cfaad7-08ef-4b76-b35c-cee371307851</entry>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="uuid">f5cfaad7-08ef-4b76-b35c-cee371307851</entry>
Nov 24 10:59:28 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 10:59:28 user nova-compute[75073]:     </system>
Nov 24 10:59:28 user nova-compute[75073]:   </sysinfo>
Nov 24 10:59:28 user nova-compute[75073]:   <os>
Nov 24 10:59:28 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 10:59:28 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 10:59:28 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 10:59:28 user nova-compute[75073]:   </os>
Nov 24 10:59:28 user nova-compute[75073]:   <features>
Nov 24 10:59:28 user nova-compute[75073]:     <acpi/>
Nov 24 10:59:28 user nova-compute[75073]:     <apic/>
Nov 24 10:59:28 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 10:59:28 user nova-compute[75073]:   </features>
Nov 24 10:59:28 user nova-compute[75073]:   <clock offset="utc">
Nov 24 10:59:28 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 10:59:28 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 10:59:28 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 10:59:28 user nova-compute[75073]:   </clock>
Nov 24 10:59:28 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 10:59:28 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 10:59:28 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 10:59:28 user nova-compute[75073]:   </cpu>
Nov 24 10:59:28 user nova-compute[75073]:   <devices>
Nov 24 10:59:28 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 10:59:28 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 10:59:28 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk"/>
Nov 24 10:59:28 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 10:59:28 user nova-compute[75073]:     </disk>
Nov 24 10:59:28 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 10:59:28 user nova-compute[75073]:       <mac address="fa:16:3e:14:02:0b"/>
Nov 24 10:59:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:59:28 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 10:59:28 user nova-compute[75073]:       <target dev="tap6c4a91ca-e8"/>
Nov 24 10:59:28 user nova-compute[75073]:     </interface>
Nov 24 10:59:28 user nova-compute[75073]:     <serial type="pty">
Nov 24 10:59:28 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/console.log" append="off"/>
Nov 24 10:59:28 user nova-compute[75073]:     </serial>
Nov 24 10:59:28 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 10:59:28 user nova-compute[75073]:     <video>
Nov 24 10:59:28 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 10:59:28 user nova-compute[75073]:     </video>
Nov 24 10:59:28 user nova-compute[75073]:     <rng model="virtio">
Nov 24 10:59:28 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 10:59:28 user nova-compute[75073]:     </rng>
Nov 24 10:59:28 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 10:59:28 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 10:59:28 user nova-compute[75073]:       <stats period="10"/>
Nov 24 10:59:28 user nova-compute[75073]:     </memballoon>
Nov 24 10:59:28 user nova-compute[75073]:   </devices>
Nov 24 10:59:28 user nova-compute[75073]: </domain>
Nov 24 10:59:28 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342651728',display_name='tempest-AttachVolumeNegativeTest-server-342651728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342651728',id=48,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtvkUbzh/hWdZcAvdMdB6wrpctteiSmyvqFA6mqqPc+j0uac/bpKXs0tcPqWYNsVUWhBVn1FmvyNzXj181iG1w9EFp+9DcNteEYE/mUfoxbrc2h+Wg6I7/v6RI6rw6ZuQ==',key_name='tempest-keypair-1724146043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-k5zpfux7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T10:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=f5cfaad7-08ef-4b76-b35c-cee371307851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG os_vif [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e77a0489-333d-5147-b9cc-1d4871e93711', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c4a91ca-e8, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c4a91ca-e8, col_values=(('qos', UUID('9e866fa5-874d-425b-90b2-242950dde200')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c4a91ca-e8, col_values=(('external_ids', {'iface-id': '6c4a91ca-e83c-4f91-82ec-e49e8d74fb51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:02:0b', 'vm-uuid': 'f5cfaad7-08ef-4b76-b35c-cee371307851'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:28 user nova-compute[75073]: INFO os_vif [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8')
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:14:02:0b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updated VIF entry in instance network info cache for port 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating instance_info_cache with network_info: [{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 10:59:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-77cd67f3-9d87-4424-860a-7ae05ea862c4 req-5a07d9b1-54a5-4c0a-b2eb-727faf335263 service nova] Releasing lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] No waiting events found dispatching network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:59:29 user nova-compute[75073]: WARNING nova.compute.manager [req-2a556ac4-d3c2-49e5-b812-f743da7dedad req-9e4ed544-c794-4742-9efd-7b0ba1e341da service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received unexpected event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 for instance with vm_state building and task_state spawning.
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 10:59:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Instance spawned successfully.
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 10:59:31 user nova-compute[75073]: INFO nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 10:59:31 user nova-compute[75073]: INFO nova.compute.manager [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Took 6.01 seconds to build instance.
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] No waiting events found dispatching network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 10:59:31 user nova-compute[75073]: WARNING nova.compute.manager [req-3235475a-0375-4ba3-9bff-91ca9fa97642 req-e8e3b0b6-10a8-47a7-b647-ce43a0c7b5fe service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received unexpected event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 for instance with vm_state active and task_state None.
Nov 24 10:59:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ef52ad98-3bd1-47ef-a49a-63369ce38890 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.126s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 10:59:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 10:59:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:02 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:02 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:00:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:00:05 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:00:06 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:00:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.160606384277344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance cc56f3d9-25f4-449d-9e65-9d239973c02d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance f5cfaad7-08ef-4b76-b35c-cee371307851 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:00:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:00:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:00:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:26 user nova-compute[75073]: INFO nova.compute.manager [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Attaching volume 480e33c5-0aa4-4127-b620-4c3ef3e24a20 to /dev/vdb
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.utils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c18e31-ef3e-4f25-9765-b434106457cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae8f86-a89b-4f20-8e7e-d0a46a8554f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac4fc2-d210-4ae3-a6d5-92e2a3b11177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf122f-7e96-4b89-9e68-4b43d65e1992]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:00:27 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:00:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a855be-9015-4fb1-b07e-f74ae6063d03]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG os_brick.utils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:00:27 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating existing volume attachment record: fd7fc1ce-6f44-4078-8a3c-90649dd32838 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:00:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:00:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:00:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:00:32 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0030460f-5fc3-4dbb-9061-ff8cedbc79a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:00:32 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aed3e5-0e7a-49b1-bfd6-a61b9cb18365]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20] added
Nov 24 11:00:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5176957-3f9a-42ab-856e-ed9db7f05a6c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d3911-0f6e-4861-bdea-b74a367f3037]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYdoGZNW {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYdoGZNW" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98496fe-b039-441c-b821-a2e55725c637]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYdoGZNW'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62633ffe-74b0-41bd-bbd2-de207b419b21]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7053b64-6cdd-4e95-8fa9-0250467d933a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:00:32 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:00:32 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:00:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:00:32 user nova-compute[75073]: 
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4aafb7-2aec-4329-8ae6-87c82f71dea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]
Nov 24 11:00:32 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.
Nov 24 11:00:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce1df3-cbe1-48e7-9fd4-f490875cb95f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[673bb312-022f-4a3e-bc1c-f95fa71fd032]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:00:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bfc3ee-80d0-4fcf-bbae-1c2b47456afe]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:00:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:00:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '26335396366666139', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335396366666139', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:00:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:00:34 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:00:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:00:34 user nova-compute[75073]:   <serial>480e33c5-0aa4-4127-b620-4c3ef3e24a20</serial>
Nov 24 11:00:34 user nova-compute[75073]: </disk>
Nov 24 11:00:34 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No VIF found with MAC fa:16:3e:06:d2:e6, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:00:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b6d3919f-1f38-4747-a18e-4c6fc6d224a9 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.630s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing instance network info cache due to event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:00:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:00:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:00:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:00:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated VIF entry in instance network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:00:41 user nova-compute[75073]: DEBUG nova.network.neutron [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:00:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9846466e-0f14-4f2e-b6d1-bd8f6b291239 req-8ecd040d-6c5d-4589-ad83-8aefda38c810 service nova] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:00:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG nova.compute.manager [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing instance network info cache due to event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated VIF entry in instance network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:00:43 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd83362a-6bfa-48a5-a6a8-17b4b094c93a req-5c88f204-9a53-47de-bc3a-6995966b192e service nova] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:47 user nova-compute[75073]: INFO nova.compute.manager [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Rebooting instance
Nov 24 11:00:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG nova.network.neutron [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.compute.manager [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:00:48 user nova-compute[75073]: WARNING nova.compute.manager [req-177dbb7e-d212-48eb-b4b5-df80cec9db29 req-17dd0038-0156-402e-82d5-a6ef67cfdfaa service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance destroyed successfully.
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'resources' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:00:48Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb0c5c77-e0, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f240fc3e-0232-45a8-b075-4129c82eb190) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:00:48 user nova-compute[75073]: INFO os_vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0')
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:00:48 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ef468-0604-4deb-9b5b-2f16bc7ca4e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:00:48 user nova-compute[75073]: No targets found.
Nov 24 11:00:48 user nova-compute[75073]: iSNS:
Nov 24 11:00:48 user nova-compute[75073]: No targets found.
Nov 24 11:00:48 user nova-compute[75073]: STATIC:
Nov 24 11:00:48 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20
Nov 24 11:00:48 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:00:48 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:00:48 user nova-compute[75073]: FIRMWARE:
Nov 24 11:00:48 user nova-compute[75073]: No targets found.
Nov 24 11:00:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:00:48 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:00:48 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f52270-68f0-4b40-aa74-634d0c5ea453]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f5e6a4-6aaa-4ffb-a7d1-4467c816eb3d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383e0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f94b0bd-5b0a-4229-b2e3-f02ebe15146a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a1f99-7c75-4dff-bd43-3c9aba3a0b0d]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c051439-c5a6-4149-9f2e-f399e251aaca]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b1a7c-3eb8-408b-864e-61b5b5a8f896]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ccffc-de94-4912-a79e-4b7c5c8444af]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4dee29-7042-48e1-ba05-3a5eb24b0ed3]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]
Nov 24 11:00:48 user nova-compute[75073]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.
Nov 24 11:00:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e42b1-ddb4-43c3-acfc-de33f1e846d7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== disconnect_volume: return (312ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:00:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start _get_guest_xml network_info=[{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9fbaea6-b26a-4afa-adca-ec1767f01242,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': 'b9fbaea6-b26a-4afa-adca-ec1767f01242'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'fd7fc1ce-6f44-4078-8a3c-90649dd32838', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cc56f3d9-25f4-449d-9e65-9d239973c02d', 'attached_at': '', 'detached_at': '', 'volume_id': '480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'serial': '480e33c5-0aa4-4127-b620-4c3ef3e24a20'}, 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:00:49 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:00:49 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9fbaea6-b26a-4afa-adca-ec1767f01242,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'vcpu_model' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.objects.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Object Instance<cc56f3d9-25f4-449d-9e65-9d239973c02d> lazy-loaded attributes: resources,vcpu_model {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:00:49 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:00:49 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:00:49 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[29534868-7421-4da2-8726-354165130c1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:00:49 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bc88b-65af-4e10-aa8a-38d3150c7133]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20] added
Nov 24 11:00:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3610178-d615-4b12-bd91-842e79132ff4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[79567778-fedd-4776-8a03-23e6bdce021f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYdoGZNW {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYdoGZNW" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3235882b-3ef0-4c0d-95b8-8d08aa59cc96]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYdoGZNW'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175064d-1ecf-48b8-b238-4e1ac8f09869]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fdd449-4009-480b-919c-d0912691f52c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:00:49 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:00:49 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:00:49 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:00:49 user nova-compute[75073]: 
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d556a8-63d5-46b7-9f79-bb9e8d2aa0b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]
Nov 24 11:00:49 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.
Nov 24 11:00:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[976adc15-097d-44d1-b16d-1ef26efd6f33]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecd40e0-99fa-41e6-973e-9c77bf02d712]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:00:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6b9ae-b017-4ec9-80b4-c33134c31bf9]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:00:49 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.compute.manager [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:00:50 user nova-compute[75073]: WARNING nova.compute.manager [req-e76cf6b5-cf6f-4030-aa89-fe351b5fb68a req-b2663eb4-3ac2-4cf4-b79e-0161d8a6a33f service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 11:00:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26335396366666139', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335396366666139', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:00:48Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'pci_devices' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.objects.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Object Instance<cc56f3d9-25f4-449d-9e65-9d239973c02d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:00:50 user nova-compute[75073]:   <uuid>cc56f3d9-25f4-449d-9e65-9d239973c02d</uuid>
Nov 24 11:00:50 user nova-compute[75073]:   <name>instance-0000002f</name>
Nov 24 11:00:50 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:00:50 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:00:50 user nova-compute[75073]:   <metadata>
Nov 24 11:00:50 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:00:50 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:name>tempest-TestMinimumBasicScenario-server-1851781203</nova:name>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:00:49</nova:creationTime>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:00:50 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:00:50 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:owner>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:user uuid="fe1d0ef3a4874771b1690ab4cd97fc2f">tempest-TestMinimumBasicScenario-1164257136-project-member</nova:user>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:project uuid="c6bdb3d4520f44e084e0342e282bf315">tempest-TestMinimumBasicScenario-1164257136</nova:project>
Nov 24 11:00:50 user nova-compute[75073]:       </nova:owner>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:root type="image" uuid="b9fbaea6-b26a-4afa-adca-ec1767f01242"/>
Nov 24 11:00:50 user nova-compute[75073]:       <nova:ports>
Nov 24 11:00:50 user nova-compute[75073]:         <nova:port uuid="db0c5c77-e0b6-4a00-9470-f6a72b435564">
Nov 24 11:00:50 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 11:00:50 user nova-compute[75073]:         </nova:port>
Nov 24 11:00:50 user nova-compute[75073]:       </nova:ports>
Nov 24 11:00:50 user nova-compute[75073]:     </nova:instance>
Nov 24 11:00:50 user nova-compute[75073]:   </metadata>
Nov 24 11:00:50 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:00:50 user nova-compute[75073]:     <system>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="serial">cc56f3d9-25f4-449d-9e65-9d239973c02d</entry>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="uuid">cc56f3d9-25f4-449d-9e65-9d239973c02d</entry>
Nov 24 11:00:50 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:00:50 user nova-compute[75073]:     </system>
Nov 24 11:00:50 user nova-compute[75073]:   </sysinfo>
Nov 24 11:00:50 user nova-compute[75073]:   <os>
Nov 24 11:00:50 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:00:50 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:00:50 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:00:50 user nova-compute[75073]:   </os>
Nov 24 11:00:50 user nova-compute[75073]:   <features>
Nov 24 11:00:50 user nova-compute[75073]:     <acpi/>
Nov 24 11:00:50 user nova-compute[75073]:     <apic/>
Nov 24 11:00:50 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:00:50 user nova-compute[75073]:   </features>
Nov 24 11:00:50 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:00:50 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:00:50 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:00:50 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:00:50 user nova-compute[75073]:   </clock>
Nov 24 11:00:50 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:00:50 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:00:50 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:00:50 user nova-compute[75073]:   </cpu>
Nov 24 11:00:50 user nova-compute[75073]:   <devices>
Nov 24 11:00:50 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:00:50 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:00:50 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk"/>
Nov 24 11:00:50 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:00:50 user nova-compute[75073]:     </disk>
Nov 24 11:00:50 user nova-compute[75073]:     <disk type="block" device="disk">
Nov 24 11:00:50 user nova-compute[75073]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:00:50 user nova-compute[75073]:       <source dev="/dev/sdb"/>
Nov 24 11:00:50 user nova-compute[75073]:       <target dev="vdb" bus="virtio"/>
Nov 24 11:00:50 user nova-compute[75073]:       <serial>480e33c5-0aa4-4127-b620-4c3ef3e24a20</serial>
Nov 24 11:00:50 user nova-compute[75073]:     </disk>
Nov 24 11:00:50 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:00:50 user nova-compute[75073]:       <mac address="fa:16:3e:06:d2:e6"/>
Nov 24 11:00:50 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:00:50 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:00:50 user nova-compute[75073]:       <target dev="tapdb0c5c77-e0"/>
Nov 24 11:00:50 user nova-compute[75073]:     </interface>
Nov 24 11:00:50 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:00:50 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/console.log" append="off"/>
Nov 24 11:00:50 user nova-compute[75073]:     </serial>
Nov 24 11:00:50 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:00:50 user nova-compute[75073]:     <video>
Nov 24 11:00:50 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:00:50 user nova-compute[75073]:     </video>
Nov 24 11:00:50 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:00:50 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:00:50 user nova-compute[75073]:     </rng>
Nov 24 11:00:50 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:00:50 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:00:50 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:00:50 user nova-compute[75073]:     </memballoon>
Nov 24 11:00:50 user nova-compute[75073]:   </devices>
Nov 24 11:00:50 user nova-compute[75073]: </domain>
Nov 24 11:00:50 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'trusted_certs' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG nova.objects.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Object Instance<cc56f3d9-25f4-449d-9e65-9d239973c02d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 11:00:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b3b473636ebdf6f21c44f3074475a992725e10 --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Cannot resize image /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'migration_context' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.objects.base [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Object Instance<cc56f3d9-25f4-449d-9e65-9d239973c02d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75073) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:00:48Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG os_vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '963440c9-7871-5018-8da1-a9d34f5c1dbb', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb0c5c77-e0, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb0c5c77-e0, col_values=(('qos', UUID('f76f1bb5-6390-41d0-89ad-b2d1bc1d904a')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb0c5c77-e0, col_values=(('external_ids', {'iface-id': 'db0c5c77-e0b6-4a00-9470-f6a72b435564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:d2:e6', 'vm-uuid': 'cc56f3d9-25f4-449d-9e65-9d239973c02d'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:00:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:51 user nova-compute[75073]: INFO os_vif [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0')
Nov 24 11:00:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:52 user nova-compute[75073]: DEBUG nova.compute.manager [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:00:52 user nova-compute[75073]: WARNING nova.compute.manager [req-b3724e54-7bf7-402b-9c07-f13d64636b5c req-d871eea1-7f7b-4327-a841-dcf9667ef5de service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 11:00:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:00:54 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance rebooted successfully.
Nov 24 11:00:54 user nova-compute[75073]: DEBUG nova.compute.manager [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-9877cbc6-1532-4b5b-9983-6caf6f5b858a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.577s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:00:54 user nova-compute[75073]: DEBUG nova.compute.manager [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:00:54 user nova-compute[75073]: WARNING nova.compute.manager [req-aed31031-b0e5-4876-ac3e-57e8849fe2bd req-df4db3d2-1ae1-4c5d-865a-8dd5c82123b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state active and task_state None.
Nov 24 11:00:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:00:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:03 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:01:06 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:01:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:01:07 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:01:07 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.158447265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:01:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance cc56f3d9-25f4-449d-9e65-9d239973c02d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance f5cfaad7-08ef-4b76-b35c-cee371307851 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:01:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:01:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:01:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:01:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:01:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:01:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating instance_info_cache with network_info: [{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:01:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:01:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:01:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-changed-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Refreshing instance network info cache due to event network-changed-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] Acquiring lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] Acquired lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Refreshing network info cache for port 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updated VIF entry in instance network info cache for port 6c4a91ca-e83c-4f91-82ec-e49e8d74fb51. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating instance_info_cache with network_info: [{"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:01:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-776e082a-f031-44fe-b955-a83b227686f4 req-c6156414-c727-419e-ac8d-a5d52daaeb3a service nova] Releasing lock "refresh_cache-f5cfaad7-08ef-4b76-b35c-cee371307851" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:01:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:01:20 user nova-compute[75073]: INFO nova.compute.manager [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Attaching volume e53b810e-742f-49c2-af73-cd3320111123 to /dev/vdb
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.utils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662617c-5b11-402d-9a77-1c8b55703e21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[871827bf-4597-4b45-9276-dc2b076f696f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af44188-1728-402a-bd2d-63243cbcf647]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a21e2fa-4ce1-4658-83af-fc3e8ed78c84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:01:20 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56bbe1a-6770-4e7b-bbdb-9e17e772c762]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG os_brick.utils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating existing volume attachment record: d926fffa-459e-4f9d-9a3a-7848f13b8da2 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:01:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:01:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRpycYKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:01:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:01:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:01:26 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bdb52a-24a5-45b9-b9f8-9d72f97b2068]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:01:26 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[58214244-e6f2-4495-bd36-630081e22852]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123] added
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0469ac8-8af2-4d0b-8f68-5ff3f6ebf391]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[791eecfe-ab6d-4b0e-bae6-47bb6b8c910c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRpycYKQ {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRpycYKQ" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b14261-e0bf-438c-92b7-ab628d317d54]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRpycYKQ'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4cde60-7adb-4c0f-a982-96b34fe9b787]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d342fc-0492-4fc2-96a7-1a2d160fca76]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb47369-f177-400c-9082-d994e1364c9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260]
Nov 24 11:01:26 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260] successful.
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194deff-13ac-4634-90bd-e237462daacf]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497f1c1-ad8f-4074-99ab-725f5755bc94]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)
Nov 24 11:01:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a0f40-4428-455f-932b-39ff7b17575f]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:26 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRpycYKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23436373734353631', 'path': '/dev/sdc'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436373734353631', 'path': '/dev/sdc'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG nova.objects.instance [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:01:27 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:01:27 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 11:01:27 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:01:27 user nova-compute[75073]:   <serial>e53b810e-742f-49c2-af73-cd3320111123</serial>
Nov 24 11:01:27 user nova-compute[75073]: </disk>
Nov 24 11:01:27 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:01:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:01:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:01:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:14:02:0b, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:01:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-fb047a48-f415-47c6-9b85-89f17d37df96 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.766s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:01:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:01:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:01:29 user nova-compute[75073]: INFO nova.compute.manager [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Detaching volume e53b810e-742f-49c2-af73-cd3320111123
Nov 24 11:01:29 user nova-compute[75073]: INFO nova.virt.block_device [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Attempting to driver detach volume e53b810e-742f-49c2-af73-cd3320111123 from mountpoint /dev/vdb
Nov 24 11:01:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Attempting to detach device vdb from instance f5cfaad7-08ef-4b76-b35c-cee371307851 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:01:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:01:29 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:01:29 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 11:01:29 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:01:29 user nova-compute[75073]:   <serial>e53b810e-742f-49c2-af73-cd3320111123</serial>
Nov 24 11:01:29 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:01:29 user nova-compute[75073]: </disk>
Nov 24 11:01:29 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:01:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance f5cfaad7-08ef-4b76-b35c-cee371307851 from the persistent domain config.
Nov 24 11:01:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5cfaad7-08ef-4b76-b35c-cee371307851 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:01:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:01:29 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:01:29 user nova-compute[75073]:   <source dev="/dev/sdc"/>
Nov 24 11:01:29 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:01:29 user nova-compute[75073]:   <serial>e53b810e-742f-49c2-af73-cd3320111123</serial>
Nov 24 11:01:29 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:01:29 user nova-compute[75073]: </disk>
Nov 24 11:01:29 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:01:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:01:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:01:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:01:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:49 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5cfaad7-08ef-4b76-b35c-cee371307851 is timed out.
Nov 24 11:01:49 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance f5cfaad7-08ef-4b76-b35c-cee371307851 from the live domain config.
Nov 24 11:01:49 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRpycYKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:01:49 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb941b1-66f7-426c-84d9-5e66a081f943]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:01:49 user nova-compute[75073]: No targets found.
Nov 24 11:01:49 user nova-compute[75073]: iSNS:
Nov 24 11:01:49 user nova-compute[75073]: No targets found.
Nov 24 11:01:49 user nova-compute[75073]: STATIC:
Nov 24 11:01:49 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20
Nov 24 11:01:49 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:01:49 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:01:49 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123
Nov 24 11:01:49 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:01:49 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:01:49 user nova-compute[75073]: FIRMWARE:
Nov 24 11:01:49 user nova-compute[75073]: No targets found.
Nov 24 11:01:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:01:49 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:01:49 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033f810-59dc-4152-afaa-35691e6553cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4300e4ac-b61a-4836-9a96-22f636a059a6]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:49 user nova-compute[75073]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)
Nov 24 11:01:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:01:49 user nova-compute[75073]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 (non-flash)
Nov 24 11:01:49 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb240268040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123'): ({'sdc'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Removing single pathed devices sdc {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780172c-948f-4e08-af27-fdd23620ef5e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:49 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd8bcc5-652d-475c-91b7-d8cd20094620]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flushing IO for device /dev/sdc {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b825e-b4c0-4f69-99da-dbb4d2a9d810]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e848f3e4-3ec0-4f18-909e-f0d622626870]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] SCSI volumes sdc have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c0d11d-bab0-4752-bd02-94f97608e0e5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b9cb83-6951-42e6-8ecc-bd0a119df17e]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260]
Nov 24 11:01:50 user nova-compute[75073]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123, portal: 172.16.0.220,3260] successful.
Nov 24 11:01:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53b810e-742f-49c2-af73-cd3320111123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d925a-df71-43a3-ab8a-6ec3bc14b275]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== disconnect_volume: return (282ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG nova.objects.instance [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:01:50 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-27a72456-8021-47ef-aa95-3bd901a6a4ea tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:01:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:01:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:03 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:03 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:02:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:02:08 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:02:09 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:02:09 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:02:09 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.14934539794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance cc56f3d9-25f4-449d-9e65-9d239973c02d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance f5cfaad7-08ef-4b76-b35c-cee371307851 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:02:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:19 user nova-compute[75073]: INFO nova.compute.manager [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Terminating instance
Nov 24 11:02:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-unplugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] No waiting events found dispatching network-vif-unplugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.compute.manager [req-60425c0f-519d-4bb9-9bda-cd9f0b6fc340 req-97e1f6f4-8227-41f5-9b88-ba42cec52417 service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-unplugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Instance destroyed successfully.
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'resources' on Instance uuid f5cfaad7-08ef-4b76-b35c-cee371307851 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-342651728',display_name='tempest-AttachVolumeNegativeTest-server-342651728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-342651728',id=48,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtvkUbzh/hWdZcAvdMdB6wrpctteiSmyvqFA6mqqPc+j0uac/bpKXs0tcPqWYNsVUWhBVn1FmvyNzXj181iG1w9EFp+9DcNteEYE/mUfoxbrc2h+Wg6I7/v6RI6rw6ZuQ==',key_name='tempest-keypair-1724146043',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-k5zpfux7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T10:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=f5cfaad7-08ef-4b76-b35c-cee371307851,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "address": "fa:16:3e:14:02:0b", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c4a91ca-e8", "ovs_interfaceid": "6c4a91ca-e83c-4f91-82ec-e49e8d74fb51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG os_vif [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c4a91ca-e8, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e866fa5-874d-425b-90b2-242950dde200) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:20 user nova-compute[75073]: INFO os_vif [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:02:0b,bridge_name='br-int',has_traffic_filtering=True,id=6c4a91ca-e83c-4f91-82ec-e49e8d74fb51,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c4a91ca-e8')
Nov 24 11:02:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Deleting instance files /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851_del
Nov 24 11:02:20 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Deletion of /opt/stack/data/nova/instances/f5cfaad7-08ef-4b76-b35c-cee371307851_del complete
Nov 24 11:02:20 user nova-compute[75073]: INFO nova.compute.manager [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 11:02:20 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:02:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:02:21 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Took 0.64 seconds to deallocate network for instance.
Nov 24 11:02:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-cf3bd90b-6f3d-4270-a0bd-df3cbbde5854 req-cbd7d9f5-d5f4-40e6-aa0f-06a78058af7e service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-deleted-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:02:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:21 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Deleted allocations for instance f5cfaad7-08ef-4b76-b35c-cee371307851
Nov 24 11:02:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-582a0722-b1be-46ac-9950-b37ac06a6106 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:02:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] Acquiring lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] Lock "f5cfaad7-08ef-4b76-b35c-cee371307851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:02:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] No waiting events found dispatching network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:02:22 user nova-compute[75073]: WARNING nova.compute.manager [req-4a33fc62-85a3-49e5-bfdd-02d3598ddeb8 req-1f89e3e6-adb8-4d2c-a2a0-4accfd995d3a service nova] [instance: f5cfaad7-08ef-4b76-b35c-cee371307851] Received unexpected event network-vif-plugged-6c4a91ca-e83c-4f91-82ec-e49e8d74fb51 for instance with vm_state deleted and task_state None.
Nov 24 11:02:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 11:02:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 11:02:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:02:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 11:02:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:02:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:02:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing instance network info cache due to event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated VIF entry in instance network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-51ffd1e5-6197-4daa-a2b3-41227dd58312 req-fb52610c-987e-48a9-b961-b5e2d5a520b1 service nova] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing instance network info cache due to event network-changed-db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] Acquiring lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] Acquired lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:02:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Refreshing network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:02:40 user nova-compute[75073]: INFO nova.compute.manager [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Detaching volume 480e33c5-0aa4-4127-b620-4c3ef3e24a20
Nov 24 11:02:40 user nova-compute[75073]: INFO nova.virt.block_device [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Attempting to driver detach volume 480e33c5-0aa4-4127-b620-4c3ef3e24a20 from mountpoint /dev/vdb
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Attempting to detach device vdb from instance cc56f3d9-25f4-449d-9e65-9d239973c02d from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:02:40 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:02:40 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:02:40 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:02:40 user nova-compute[75073]:   <serial>480e33c5-0aa4-4127-b620-4c3ef3e24a20</serial>
Nov 24 11:02:40 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 11:02:40 user nova-compute[75073]: </disk>
Nov 24 11:02:40 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:02:40 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully detached device vdb from instance cc56f3d9-25f4-449d-9e65-9d239973c02d from the persistent domain config.
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc56f3d9-25f4-449d-9e65-9d239973c02d from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:02:40 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:02:40 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:02:40 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:02:40 user nova-compute[75073]:   <serial>480e33c5-0aa4-4127-b620-4c3ef3e24a20</serial>
Nov 24 11:02:40 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 11:02:40 user nova-compute[75073]: </disk>
Nov 24 11:02:40 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updated VIF entry in instance network info cache for port db0c5c77-e0b6-4a00-9470-f6a72b435564. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.network.neutron [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [{"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-a97fddd2-12a8-4238-af1e-b19d12489f3c req-89223ffc-320e-4109-a4c7-d6dd9ef4b62a service nova] Releasing lock "refresh_cache-cc56f3d9-25f4-449d-9e65-9d239973c02d" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:02:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:02:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:02:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:00 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc56f3d9-25f4-449d-9e65-9d239973c02d is timed out.
Nov 24 11:03:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully detached device vdb from instance cc56f3d9-25f4-449d-9e65-9d239973c02d from the live domain config.
Nov 24 11:03:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYdoGZNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:03:00 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2248f-b675-4440-ba82-f2c66c735f99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:03:00 user nova-compute[75073]: No targets found.
Nov 24 11:03:00 user nova-compute[75073]: iSNS:
Nov 24 11:03:00 user nova-compute[75073]: No targets found.
Nov 24 11:03:00 user nova-compute[75073]: STATIC:
Nov 24 11:03:00 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20
Nov 24 11:03:00 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:03:00 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:03:00 user nova-compute[75073]: FIRMWARE:
Nov 24 11:03:00 user nova-compute[75073]: No targets found.
Nov 24 11:03:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:03:00 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:03:00 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d619331-4652-4c0c-93c3-c2c88ba92377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a9d97d-17c7-4b17-bc24-49d91b83989f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:03:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 (non-flash)
Nov 24 11:03:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2382465f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca4cb0-f352-4e50-9600-57ac5bbc0a4f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bef198-eeb4-4ced-b94f-49ca69e6f797]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[891ff68f-a438-4ea6-88f1-2564b70f5a74]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5b14c-0a92-4e7d-966d-f97ad9cee1d0]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d700b5-8392-446f-95cf-8116acc08c54]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c75944-6faf-47e5-97e0-57633873f67b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260]
Nov 24 11:03:00 user nova-compute[75073]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20, portal: 172.16.0.220,3260] successful.
Nov 24 11:03:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:480e33c5-0aa4-4127-b620-4c3ef3e24a20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0719905-247f-46e6-bd28-a632c604d237]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== disconnect_volume: return (275ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:03:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:03:01 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:03:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ecf37389-3a08-43c6-9b09-8dcaedca6255 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:03:09 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:03:10 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:03:11 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.176284790039062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance cc56f3d9-25f4-449d-9e65-9d239973c02d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:03:11 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 11:03:13 user nova-compute[75073]: INFO nova.compute.claims [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Claim successful on node user
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 11:03:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.policy [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016b326ea3eb4679a05c71c8ebd74763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd156576cab144c73be55e1acc81af148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 11:03:13 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Creating image(s)
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "/opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "/opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk 1073741824" returned: 0 in 0.046s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Successfully created port: 0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Cannot resize image /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Ensure instance console log exists: /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Successfully updated port: 0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquired lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-changed-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.compute.manager [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Refreshing instance network info cache due to event network-changed-0ba09bac-8341-4626-8ec7-32db55b34f80. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] Acquiring lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.neutron [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Releasing lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Instance network_info: |[{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] Acquired lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Refreshing network info cache for port 0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Start _get_guest_xml network_info=[{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:03:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:03:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947298708',display_name='tempest-AttachVolumeNegativeTest-server-1947298708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947298708',id=49,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvDvcQtMi2B/UyWnPrahuBURz273S2OGIgqnPO9+/lBfh13InAWJJWEkcejVHqUDD1jaRa6zznE7lRFaHlOSrrD3DJ1yH5kCL72aRoPRGQ9hLG9st7cAyjAwxN4E3YNIw==',key_name='tempest-keypair-1511669383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-agzhbd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=111b227e-31ec-4ab4-b392-090ca9992091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.objects.instance [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'pci_devices' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:03:15 user nova-compute[75073]:   <uuid>111b227e-31ec-4ab4-b392-090ca9992091</uuid>
Nov 24 11:03:15 user nova-compute[75073]:   <name>instance-00000031</name>
Nov 24 11:03:15 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:03:15 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:03:15 user nova-compute[75073]:   <metadata>
Nov 24 11:03:15 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:03:15 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1947298708</nova:name>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:03:15</nova:creationTime>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:03:15 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:03:15 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:owner>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:user uuid="016b326ea3eb4679a05c71c8ebd74763">tempest-AttachVolumeNegativeTest-323602591-project-member</nova:user>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:project uuid="d156576cab144c73be55e1acc81af148">tempest-AttachVolumeNegativeTest-323602591</nova:project>
Nov 24 11:03:15 user nova-compute[75073]:       </nova:owner>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 11:03:15 user nova-compute[75073]:       <nova:ports>
Nov 24 11:03:15 user nova-compute[75073]:         <nova:port uuid="0ba09bac-8341-4626-8ec7-32db55b34f80">
Nov 24 11:03:15 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 11:03:15 user nova-compute[75073]:         </nova:port>
Nov 24 11:03:15 user nova-compute[75073]:       </nova:ports>
Nov 24 11:03:15 user nova-compute[75073]:     </nova:instance>
Nov 24 11:03:15 user nova-compute[75073]:   </metadata>
Nov 24 11:03:15 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:03:15 user nova-compute[75073]:     <system>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="serial">111b227e-31ec-4ab4-b392-090ca9992091</entry>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="uuid">111b227e-31ec-4ab4-b392-090ca9992091</entry>
Nov 24 11:03:15 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:03:15 user nova-compute[75073]:     </system>
Nov 24 11:03:15 user nova-compute[75073]:   </sysinfo>
Nov 24 11:03:15 user nova-compute[75073]:   <os>
Nov 24 11:03:15 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:03:15 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:03:15 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:03:15 user nova-compute[75073]:   </os>
Nov 24 11:03:15 user nova-compute[75073]:   <features>
Nov 24 11:03:15 user nova-compute[75073]:     <acpi/>
Nov 24 11:03:15 user nova-compute[75073]:     <apic/>
Nov 24 11:03:15 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:03:15 user nova-compute[75073]:   </features>
Nov 24 11:03:15 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:03:15 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:03:15 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:03:15 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:03:15 user nova-compute[75073]:   </clock>
Nov 24 11:03:15 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:03:15 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:03:15 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:03:15 user nova-compute[75073]:   </cpu>
Nov 24 11:03:15 user nova-compute[75073]:   <devices>
Nov 24 11:03:15 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:03:15 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:03:15 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk"/>
Nov 24 11:03:15 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:03:15 user nova-compute[75073]:     </disk>
Nov 24 11:03:15 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:03:15 user nova-compute[75073]:       <mac address="fa:16:3e:3e:f2:f3"/>
Nov 24 11:03:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:03:15 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:03:15 user nova-compute[75073]:       <target dev="tap0ba09bac-83"/>
Nov 24 11:03:15 user nova-compute[75073]:     </interface>
Nov 24 11:03:15 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:03:15 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/console.log" append="off"/>
Nov 24 11:03:15 user nova-compute[75073]:     </serial>
Nov 24 11:03:15 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:03:15 user nova-compute[75073]:     <video>
Nov 24 11:03:15 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:03:15 user nova-compute[75073]:     </video>
Nov 24 11:03:15 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:03:15 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:03:15 user nova-compute[75073]:     </rng>
Nov 24 11:03:15 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:03:15 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:03:15 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:03:15 user nova-compute[75073]:     </memballoon>
Nov 24 11:03:15 user nova-compute[75073]:   </devices>
Nov 24 11:03:15 user nova-compute[75073]: </domain>
Nov 24 11:03:15 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947298708',display_name='tempest-AttachVolumeNegativeTest-server-1947298708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947298708',id=49,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvDvcQtMi2B/UyWnPrahuBURz273S2OGIgqnPO9+/lBfh13InAWJJWEkcejVHqUDD1jaRa6zznE7lRFaHlOSrrD3DJ1yH5kCL72aRoPRGQ9hLG9st7cAyjAwxN4E3YNIw==',key_name='tempest-keypair-1511669383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-agzhbd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=111b227e-31ec-4ab4-b392-090ca9992091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG os_vif [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '603b4d47-b402-56fb-9684-e3d63177f727', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ba09bac-83, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ba09bac-83, col_values=(('qos', UUID('fff95795-08c2-46e4-b138-dbe4836eecc4')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ba09bac-83, col_values=(('external_ids', {'iface-id': '0ba09bac-8341-4626-8ec7-32db55b34f80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:f2:f3', 'vm-uuid': '111b227e-31ec-4ab4-b392-090ca9992091'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:16 user nova-compute[75073]: INFO os_vif [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83')
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:3e:f2:f3, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updated VIF entry in instance network info cache for port 0ba09bac-8341-4626-8ec7-32db55b34f80. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.network.neutron [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bbd91d1f-5674-405e-871c-34db7e1aaf16 req-76fe47c4-a932-45a1-9efd-5bc1287ab8c2 service nova] Releasing lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:03:16 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG nova.compute.manager [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] No waiting events found dispatching network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:03:17 user nova-compute[75073]: WARNING nova.compute.manager [req-066efab5-80da-4913-8768-d7296a84586a req-1676bf89-c3ed-4fc2-8fdf-594999591c2d service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received unexpected event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 for instance with vm_state building and task_state spawning.
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 11:03:19 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Instance spawned successfully.
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.compute.manager [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] No waiting events found dispatching network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:03:19 user nova-compute[75073]: WARNING nova.compute.manager [req-081873e7-3bc6-49f9-a6a0-dccbd4df908e req-6b3c5314-b490-4f38-99f2-5374ec122ada service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received unexpected event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 for instance with vm_state building and task_state spawning.
Nov 24 11:03:19 user nova-compute[75073]: INFO nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 24 11:03:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:03:19 user nova-compute[75073]: INFO nova.compute.manager [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Took 6.21 seconds to build instance.
Nov 24 11:03:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-88189fe9-16aa-45c4-a26e-55a7f8e5906b tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.303s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:03:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:33 user nova-compute[75073]: INFO nova.compute.manager [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Terminating instance
Nov 24 11:03:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-2598a0ae-f0e1-4df8-8bbf-b1b214c94da0 req-d6ecc2e8-d3d8-4a26-813f-e269d5ba9812 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-unplugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Instance destroyed successfully.
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'resources' on Instance uuid cc56f3d9-25f4-449d-9e65-9d239973c02d {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T10:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1851781203',display_name='tempest-TestMinimumBasicScenario-server-1851781203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1851781203',id=47,image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOloGHB6w/3Mq67IWZJ7n33nbRnktIeIWaepr95gKA92Ack183xWButYGJUulDWOl4srfgvxhkStBLoClGNo8529PCsZpuQXPneSjcFnAwVK/5gDK0unI/z1GjiYnecUCA==',key_name='tempest-TestMinimumBasicScenario-2116380086',keypairs=<?>,launch_index=0,launched_at=2023-11-24T10:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-b4kv8lc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9fbaea6-b26a-4afa-adca-ec1767f01242',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:00:55Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=cc56f3d9-25f4-449d-9e65-9d239973c02d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "address": "fa:16:3e:06:d2:e6", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb0c5c77-e0", "ovs_interfaceid": "db0c5c77-e0b6-4a00-9470-f6a72b435564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG os_vif [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb0c5c77-e0, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f76f1bb5-6390-41d0-89ad-b2d1bc1d904a) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:34 user nova-compute[75073]: INFO os_vif [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d2:e6,bridge_name='br-int',has_traffic_filtering=True,id=db0c5c77-e0b6-4a00-9470-f6a72b435564,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb0c5c77-e0')
Nov 24 11:03:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Deleting instance files /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d_del
Nov 24 11:03:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Deletion of /opt/stack/data/nova/instances/cc56f3d9-25f4-449d-9e65-9d239973c02d_del complete
Nov 24 11:03:34 user nova-compute[75073]: INFO nova.compute.manager [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 24 11:03:34 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:03:34 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:03:35 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Took 0.44 seconds to deallocate network for instance.
Nov 24 11:03:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-5e629be7-a947-4a14-882b-61fef4a04153 req-8d0650fd-f8ae-491a-85ea-e857bd8cb158 service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-deleted-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:03:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:35 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Deleted allocations for instance cc56f3d9-25f4-449d-9e65-9d239973c02d
Nov 24 11:03:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ba36f9cc-6bb5-4280-9b88-dbe1b13849c5 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:03:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] Acquiring lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:03:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:03:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] Lock "cc56f3d9-25f4-449d-9e65-9d239973c02d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:03:36 user nova-compute[75073]: DEBUG nova.compute.manager [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] No waiting events found dispatching network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:03:36 user nova-compute[75073]: WARNING nova.compute.manager [req-7ce7b6d1-3c4b-496c-a7cd-47842b8e5cad req-cd27bf0c-9af9-42b8-9ec4-c4d6253dc03a service nova] [instance: cc56f3d9-25f4-449d-9e65-9d239973c02d] Received unexpected event network-vif-plugged-db0c5c77-e0b6-4a00-9470-f6a72b435564 for instance with vm_state deleted and task_state None.
Nov 24 11:03:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:03:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:04:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:04:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:04:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:13 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:04:13 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.17452621459961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 111b227e-31ec-4ab4-b392-090ca9992091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:04:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:04:18 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:04:19 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:04:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:04:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:04:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:04:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 11:04:27 user nova-compute[75073]: INFO nova.compute.claims [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Claim successful on node user
Nov 24 11:04:27 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:04:27 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 11:04:28 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.policy [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1d0ef3a4874771b1690ab4cd97fc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdb3d4520f44e084e0342e282bf315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 11:04:28 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Creating image(s)
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "/opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "/opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Successfully created port: 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.virt.images [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] 916ba4dd-61d9-4a8a-9859-c21b84dbd9aa was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 11:04:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.part /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.part /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.converted" returned: 0 in 0.318s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Successfully updated port: 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-changed-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing instance network info cache due to event network-changed-28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.216s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance network_info: |[{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json" returned: 0 in 0.337s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278,backing_fmt=raw /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278,backing_fmt=raw /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk 1073741824" returned: 0 in 0.047s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.neutron [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated VIF entry in instance network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.neutron [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aefb9e7ff1c3ea6010ae43bef1d591cc5fc0278 --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ecd9d74e-88ef-45ad-8f01-d465dce283db req-f5521d88-0cc7-4940-b821-8cf50bb5e830 service nova] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Cannot resize image /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Ensure instance console log exists: /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Start _get_guest_xml network_info=[{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T11:04:25Z,direct_url=<?>,disk_format='qcow2',id=916ba4dd-61d9-4a8a-9859-c21b84dbd9aa,min_disk=0,min_ram=0,name='tempest-scenario-img--935664891',owner='c6bdb3d4520f44e084e0342e282bf315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T11:04:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '916ba4dd-61d9-4a8a-9859-c21b84dbd9aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:04:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:04:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T11:04:25Z,direct_url=<?>,disk_format='qcow2',id=916ba4dd-61d9-4a8a-9859-c21b84dbd9aa,min_disk=0,min_ram=0,name='tempest-scenario-img--935664891',owner='c6bdb3d4520f44e084e0342e282bf315',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T11:04:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-516299369',display_name='tempest-TestMinimumBasicScenario-server-516299369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-516299369',id=50,image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyxvxGg2imGSTZLxSz/MozcuRTe/EIYIL/XLjBAkAN1+CG+s3RMqhNexcXRGPGzBr9NILsNWe04aTvAENRKRuFmlb4hxX9vVNy4z1WbmEoRPw494sKg27hcJzMINFmOzQ==',key_name='tempest-TestMinimumBasicScenario-58351296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-w0au8k1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:04:28Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=ef2b46c1-3027-4036-80fa-bf48b6b8a0a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'pci_devices' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:04:30 user nova-compute[75073]:   <uuid>ef2b46c1-3027-4036-80fa-bf48b6b8a0a8</uuid>
Nov 24 11:04:30 user nova-compute[75073]:   <name>instance-00000032</name>
Nov 24 11:04:30 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:04:30 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:04:30 user nova-compute[75073]:   <metadata>
Nov 24 11:04:30 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:04:30 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:name>tempest-TestMinimumBasicScenario-server-516299369</nova:name>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:04:30</nova:creationTime>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:04:30 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:04:30 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:owner>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:user uuid="fe1d0ef3a4874771b1690ab4cd97fc2f">tempest-TestMinimumBasicScenario-1164257136-project-member</nova:user>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:project uuid="c6bdb3d4520f44e084e0342e282bf315">tempest-TestMinimumBasicScenario-1164257136</nova:project>
Nov 24 11:04:30 user nova-compute[75073]:       </nova:owner>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:root type="image" uuid="916ba4dd-61d9-4a8a-9859-c21b84dbd9aa"/>
Nov 24 11:04:30 user nova-compute[75073]:       <nova:ports>
Nov 24 11:04:30 user nova-compute[75073]:         <nova:port uuid="28308072-df1c-4129-bd1d-03063bb27d78">
Nov 24 11:04:30 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 11:04:30 user nova-compute[75073]:         </nova:port>
Nov 24 11:04:30 user nova-compute[75073]:       </nova:ports>
Nov 24 11:04:30 user nova-compute[75073]:     </nova:instance>
Nov 24 11:04:30 user nova-compute[75073]:   </metadata>
Nov 24 11:04:30 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:04:30 user nova-compute[75073]:     <system>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="serial">ef2b46c1-3027-4036-80fa-bf48b6b8a0a8</entry>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="uuid">ef2b46c1-3027-4036-80fa-bf48b6b8a0a8</entry>
Nov 24 11:04:30 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:04:30 user nova-compute[75073]:     </system>
Nov 24 11:04:30 user nova-compute[75073]:   </sysinfo>
Nov 24 11:04:30 user nova-compute[75073]:   <os>
Nov 24 11:04:30 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:04:30 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:04:30 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:04:30 user nova-compute[75073]:   </os>
Nov 24 11:04:30 user nova-compute[75073]:   <features>
Nov 24 11:04:30 user nova-compute[75073]:     <acpi/>
Nov 24 11:04:30 user nova-compute[75073]:     <apic/>
Nov 24 11:04:30 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:04:30 user nova-compute[75073]:   </features>
Nov 24 11:04:30 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:04:30 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:04:30 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:04:30 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:04:30 user nova-compute[75073]:   </clock>
Nov 24 11:04:30 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:04:30 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:04:30 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:04:30 user nova-compute[75073]:   </cpu>
Nov 24 11:04:30 user nova-compute[75073]:   <devices>
Nov 24 11:04:30 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:04:30 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:04:30 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk"/>
Nov 24 11:04:30 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:04:30 user nova-compute[75073]:     </disk>
Nov 24 11:04:30 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:04:30 user nova-compute[75073]:       <mac address="fa:16:3e:5f:f5:41"/>
Nov 24 11:04:30 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:04:30 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:04:30 user nova-compute[75073]:       <target dev="tap28308072-df"/>
Nov 24 11:04:30 user nova-compute[75073]:     </interface>
Nov 24 11:04:30 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:04:30 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/console.log" append="off"/>
Nov 24 11:04:30 user nova-compute[75073]:     </serial>
Nov 24 11:04:30 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:04:30 user nova-compute[75073]:     <video>
Nov 24 11:04:30 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:04:30 user nova-compute[75073]:     </video>
Nov 24 11:04:30 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:04:30 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:04:30 user nova-compute[75073]:     </rng>
Nov 24 11:04:30 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:04:30 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:04:30 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:04:30 user nova-compute[75073]:     </memballoon>
Nov 24 11:04:30 user nova-compute[75073]:   </devices>
Nov 24 11:04:30 user nova-compute[75073]: </domain>
Nov 24 11:04:30 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-516299369',display_name='tempest-TestMinimumBasicScenario-server-516299369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-516299369',id=50,image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyxvxGg2imGSTZLxSz/MozcuRTe/EIYIL/XLjBAkAN1+CG+s3RMqhNexcXRGPGzBr9NILsNWe04aTvAENRKRuFmlb4hxX9vVNy4z1WbmEoRPw494sKg27hcJzMINFmOzQ==',key_name='tempest-TestMinimumBasicScenario-58351296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-w0au8k1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:04:28Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=ef2b46c1-3027-4036-80fa-bf48b6b8a0a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG os_vif [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fb5be3d-cd0c-5758-b199-ddfc11f68b4d', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28308072-df, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28308072-df, col_values=(('qos', UUID('c7b2346e-629d-4a4c-a63e-a87e8c773583')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28308072-df, col_values=(('external_ids', {'iface-id': '28308072-df1c-4129-bd1d-03063bb27d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f5:41', 'vm-uuid': 'ef2b46c1-3027-4036-80fa-bf48b6b8a0a8'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:30 user nova-compute[75073]: INFO os_vif [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df')
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:04:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No VIF found with MAC fa:16:3e:5f:f5:41, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:04:31 user nova-compute[75073]: WARNING nova.compute.manager [req-aaccd686-71de-46a4-acb3-110cf261a403 req-a613472e-54ae-4f10-9fdf-7da088ff4b46 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state building and task_state spawning.
Nov 24 11:04:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 11:04:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance spawned successfully.
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:04:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:04:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:04:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:04:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:04:34 user nova-compute[75073]: WARNING nova.compute.manager [req-9b91ce25-4e2f-46a1-9487-5842d87abae9 req-d8acb048-dbbb-48f9-bec9-7d3d19d1d2bb service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state building and task_state spawning.
Nov 24 11:04:34 user nova-compute[75073]: INFO nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 24 11:04:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:04:34 user nova-compute[75073]: INFO nova.compute.manager [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Took 6.30 seconds to build instance.
Nov 24 11:04:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b4fa554a-fcdd-42d1-9f87-d93ab50bda0f tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.440s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:04:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:53 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:04:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-changed-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:05:04 user nova-compute[75073]: DEBUG nova.compute.manager [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Refreshing instance network info cache due to event network-changed-0ba09bac-8341-4626-8ec7-32db55b34f80. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:05:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] Acquiring lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:05:04 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] Acquired lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:05:04 user nova-compute[75073]: DEBUG nova.network.neutron [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Refreshing network info cache for port 0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updated VIF entry in instance network info cache for port 0ba09bac-8341-4626-8ec7-32db55b34f80. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG nova.network.neutron [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-6a61768a-6707-4ac8-b1a9-7ba754028b5f req-ff2ec0e1-53a1-400b-91e0-6475e3c187f7 service nova] Releasing lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:05 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:05:07 user nova-compute[75073]: INFO nova.compute.manager [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Attaching volume e3304b39-8918-47c5-a1f4-c97ca9f70f08 to /dev/vdb
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4985d92-4ed2-4c3e-8aa8-3e537765ec97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fed9f3-6088-489b-9d4e-4a0640ba0165]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[421791d1-7f1f-4922-b407-24e6d8b27ece]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a9298-fca4-46d7-b6b2-bbc1649c4631]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:05:07 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:05:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4619e-d7f2-46fc-a8ae-e6a5c5bd7882]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:05:07 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating existing volume attachment record: ffcc3177-da76-417a-898f-28d51e52368a {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:05:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUqaBJCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:05:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:05:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:05:13 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3dd06-4102-4559-8403-71a180923a45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:05:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea382826-f44b-4435-9d62-03bf11939a5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08] added
Nov 24 11:05:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b5b73e-af13-4a0a-9ccd-8238753bdabc]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1567b-1499-400d-8e5f-afb0770c00aa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUqaBJCv {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hUqaBJCv" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[72761028-8e5d-44f4-90bf-111947dd7409]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hUqaBJCv'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1bf47e-1655-4a48-b256-855cd48583a6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[67654a24-177d-4d45-81d7-29e67923426c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:05:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:05:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:05:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:05:13 user nova-compute[75073]: 
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2773213f-fbf9-452c-9f47-525707c150de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260]
Nov 24 11:05:13 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260] successful.
Nov 24 11:05:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab8d8c-123b-4b27-8639-7aca73735d01]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4aa8e-17fa-457c-81f8-751f89b67855]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)
Nov 24 11:05:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)
Nov 24 11:05:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[14627e27-e60f-4687-b000-7b97a28aaf38]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:05:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUqaBJCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:05:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:05:14 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.123798370361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23262656239393938', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:05:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262656239393938', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.objects.instance [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:05:15 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:05:15 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:05:15 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:05:15 user nova-compute[75073]:   <serial>e3304b39-8918-47c5-a1f4-c97ca9f70f08</serial>
Nov 24 11:05:15 user nova-compute[75073]: </disk>
Nov 24 11:05:15 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 111b227e-31ec-4ab4-b392-090ca9992091 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] No VIF found with MAC fa:16:3e:3e:f2:f3, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf9b8343-9be3-4f31-aec8-f6da7b69625d tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.997s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:05:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:05:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:05:16 user nova-compute[75073]: INFO nova.compute.manager [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Detaching volume e3304b39-8918-47c5-a1f4-c97ca9f70f08
Nov 24 11:05:16 user nova-compute[75073]: INFO nova.virt.block_device [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Attempting to driver detach volume e3304b39-8918-47c5-a1f4-c97ca9f70f08 from mountpoint /dev/vdb
Nov 24 11:05:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Attempting to detach device vdb from instance 111b227e-31ec-4ab4-b392-090ca9992091 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:05:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:05:16 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:05:16 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:05:16 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:05:16 user nova-compute[75073]:   <serial>e3304b39-8918-47c5-a1f4-c97ca9f70f08</serial>
Nov 24 11:05:16 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:05:16 user nova-compute[75073]: </disk>
Nov 24 11:05:16 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:05:16 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance 111b227e-31ec-4ab4-b392-090ca9992091 from the persistent domain config.
Nov 24 11:05:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 111b227e-31ec-4ab4-b392-090ca9992091 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:05:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:05:16 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:05:16 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:05:16 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:05:16 user nova-compute[75073]:   <serial>e3304b39-8918-47c5-a1f4-c97ca9f70f08</serial>
Nov 24 11:05:16 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:05:16 user nova-compute[75073]: </disk>
Nov 24 11:05:16 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:05:17 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:05:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:05:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:05:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [{"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:05:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-111b227e-31ec-4ab4-b392-090ca9992091" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:05:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:05:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:05:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:05:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:05:37 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 111b227e-31ec-4ab4-b392-090ca9992091 is timed out.
Nov 24 11:05:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully detached device vdb from instance 111b227e-31ec-4ab4-b392-090ca9992091 from the live domain config.
Nov 24 11:05:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hUqaBJCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:05:37 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc58e40-6f9e-4f4a-a382-6cdb4d3b1b87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:05:37 user nova-compute[75073]: No targets found.
Nov 24 11:05:37 user nova-compute[75073]: iSNS:
Nov 24 11:05:37 user nova-compute[75073]: No targets found.
Nov 24 11:05:37 user nova-compute[75073]: STATIC:
Nov 24 11:05:37 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08
Nov 24 11:05:37 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:05:37 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:05:37 user nova-compute[75073]: FIRMWARE:
Nov 24 11:05:37 user nova-compute[75073]: No targets found.
Nov 24 11:05:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:05:37 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:05:37 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5078324-91f3-4140-9e12-405234f7263b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c5812-81c7-4d37-906d-42d9c3e9a827]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)
Nov 24 11:05:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 (non-flash)
Nov 24 11:05:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2147563b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[088cd6fb-22cd-4289-8d2b-704adaa93aba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[90013cd0-e848-4276-8931-93847609228e]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbda3657-7ba9-4660-ac93-03a3e553eb37]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5e4924-1743-410e-9382-df1379d55ee1]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[44370cf0-9e9e-4b83-9442-c53ebffa45ce]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b3fc4f-147f-4411-b7fc-1297fc70c48b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260]
Nov 24 11:05:37 user nova-compute[75073]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08, portal: 172.16.0.220,3260] successful.
Nov 24 11:05:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3304b39-8918-47c5-a1f4-c97ca9f70f08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb883d-eb16-4923-81e5-94f7cdd27c6d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] <== disconnect_volume: return (289ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:05:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:05:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'flavor' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:05:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b830222f-523a-4798-9e18-b6dbb9c1b389 tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:05:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:05:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:06 user nova-compute[75073]: INFO nova.compute.manager [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Terminating instance
Nov 24 11:06:06 user nova-compute[75073]: DEBUG nova.compute.manager [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-unplugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] No waiting events found dispatching network-vif-unplugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.compute.manager [req-46ff26e0-1910-476f-8c6d-589de3a72c09 req-cf8abcd1-9099-416a-ad72-46ce34f2d747 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-unplugged-0ba09bac-8341-4626-8ec7-32db55b34f80 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Instance destroyed successfully.
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lazy-loading 'resources' on Instance uuid 111b227e-31ec-4ab4-b392-090ca9992091 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1947298708',display_name='tempest-AttachVolumeNegativeTest-server-1947298708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1947298708',id=49,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvDvcQtMi2B/UyWnPrahuBURz273S2OGIgqnPO9+/lBfh13InAWJJWEkcejVHqUDD1jaRa6zznE7lRFaHlOSrrD3DJ1yH5kCL72aRoPRGQ9hLG9st7cAyjAwxN4E3YNIw==',key_name='tempest-keypair-1511669383',keypairs=<?>,launch_index=0,launched_at=2023-11-24T11:03:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d156576cab144c73be55e1acc81af148',ramdisk_id='',reservation_id='r-agzhbd0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-323602591',owner_user_name='tempest-AttachVolumeNegativeTest-323602591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:03:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016b326ea3eb4679a05c71c8ebd74763',uuid=111b227e-31ec-4ab4-b392-090ca9992091,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converting VIF {"id": "0ba09bac-8341-4626-8ec7-32db55b34f80", "address": "fa:16:3e:3e:f2:f3", "network": {"id": "23709c72-c4ff-4655-a8f4-d30a47da3b88", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1324329676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d156576cab144c73be55e1acc81af148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ba09bac-83", "ovs_interfaceid": "0ba09bac-8341-4626-8ec7-32db55b34f80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG os_vif [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ba09bac-83, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fff95795-08c2-46e4-b138-dbe4836eecc4) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:07 user nova-compute[75073]: INFO os_vif [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f2:f3,bridge_name='br-int',has_traffic_filtering=True,id=0ba09bac-8341-4626-8ec7-32db55b34f80,network=Network(23709c72-c4ff-4655-a8f4-d30a47da3b88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ba09bac-83')
Nov 24 11:06:07 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Deleting instance files /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091_del
Nov 24 11:06:07 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Deletion of /opt/stack/data/nova/instances/111b227e-31ec-4ab4-b392-090ca9992091_del complete
Nov 24 11:06:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:06:07 user nova-compute[75073]: INFO nova.compute.manager [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 24 11:06:07 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:06:07 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-70be470b-0471-4353-8cd3-709eb93572b4 req-d1689ab8-febc-4b89-8f15-933baf9fc425 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-deleted-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:08 user nova-compute[75073]: INFO nova.compute.manager [req-70be470b-0471-4353-8cd3-709eb93572b4 req-d1689ab8-febc-4b89-8f15-933baf9fc425 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Neutron deleted interface 0ba09bac-8341-4626-8ec7-32db55b34f80; detaching it from the instance and deleting it from the info cache
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.network.neutron [req-70be470b-0471-4353-8cd3-709eb93572b4 req-d1689ab8-febc-4b89-8f15-933baf9fc425 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:08 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Took 0.71 seconds to deallocate network for instance.
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.compute.manager [req-70be470b-0471-4353-8cd3-709eb93572b4 req-d1689ab8-febc-4b89-8f15-933baf9fc425 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Detach interface failed, port_id=0ba09bac-8341-4626-8ec7-32db55b34f80, reason: Instance 111b227e-31ec-4ab4-b392-090ca9992091 could not be found. {{(pid=75073) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:06:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:08 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Deleted allocations for instance 111b227e-31ec-4ab4-b392-090ca9992091
Nov 24 11:06:08 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-883f569f-b4e1-4ace-80ac-320d6b3dcbcc tempest-AttachVolumeNegativeTest-323602591 tempest-AttachVolumeNegativeTest-323602591-project-member] Lock "111b227e-31ec-4ab4-b392-090ca9992091" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] Acquiring lock "111b227e-31ec-4ab4-b392-090ca9992091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:09 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] Lock "111b227e-31ec-4ab4-b392-090ca9992091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:09 user nova-compute[75073]: DEBUG nova.compute.manager [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] No waiting events found dispatching network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:09 user nova-compute[75073]: WARNING nova.compute.manager [req-f5b00b00-33c6-4c33-8842-072e95ecb60a req-deaa3247-629d-4e17-bb1d-659157b27f62 service nova] [instance: 111b227e-31ec-4ab4-b392-090ca9992091] Received unexpected event network-vif-plugged-0ba09bac-8341-4626-8ec7-32db55b34f80 for instance with vm_state deleted and task_state None.
Nov 24 11:06:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:06:14 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:06:15 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.15074920654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:06:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:20 user nova-compute[75073]: INFO nova.compute.manager [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Attaching volume 02ff1b30-3fcb-4504-900b-bff2584da4e5 to /dev/vdb
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2660022d-e58f-41ae-9b32-203f4de8f130]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0ab754-b155-4414-b663-8e9b15fb2f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7f0a95-31dc-4da0-88fa-8c97ede6ee44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995e4c0-b4ec-4ad1-b6c2-ab874ca40b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:06:21 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f200c5-179a-4755-9dbe-6d09db89de77]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating existing volume attachment record: fa4648f7-da6e-4b55-bbb4-a2c08693755c {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:06:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:06:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:06:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:06:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjrqWXtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:06:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:06:26 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:06:26 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35dddcc-6ece-4e62-a074-c4949ea63d56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:06:26 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89e3f38-5e2d-41f2-84d9-5622100fd156]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5] added
Nov 24 11:06:26 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ec5c36-5bd0-424c-9499-7c7cb5853390]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49e66a-e43a-4d02-b0b2-5f7f139119a4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjrqWXtL {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjrqWXtL" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe0d63-7a24-4e2e-bad2-39ba9bd2eae5]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjrqWXtL'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.080s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[52368ceb-aba8-4c75-98c4-ff0bee88e9d9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[747dcb6e-521d-433b-ac96-55b507a379a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:06:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:06:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:06:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:06:27 user nova-compute[75073]: 
Nov 24 11:06:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --login" returned: 0 in 1.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac1695-199d-4e72-bfde-dcb8797fe6fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260]
Nov 24 11:06:28 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260] successful.
Nov 24 11:06:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a12e24-8efd-4f7e-92ca-cc43a9f78a2f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48692222-eb94-415a-80c3-7dc92c2fa0ce]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)
Nov 24 11:06:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)
Nov 24 11:06:28 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.308s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ccf6c-0eea-4b60-a37b-8ae664d14d31]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:06:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjrqWXtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.343s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== connect_volume: return (2345ms) {'type': 'block', 'scsi_wwn': '26239666139653038', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239666139653038', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:06:29 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:06:29 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:06:29 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:06:29 user nova-compute[75073]:   <serial>02ff1b30-3fcb-4504-900b-bff2584da4e5</serial>
Nov 24 11:06:29 user nova-compute[75073]: </disk>
Nov 24 11:06:29 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] No VIF found with MAC fa:16:3e:5f:f5:41, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:06:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c7aa8a01-042f-41da-b350-aa4605f2f442 tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.910s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-changed-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG nova.compute.manager [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing instance network info cache due to event network-changed-28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated VIF entry in instance network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c647b64-6675-42bf-b52b-ffdaba52efa8 req-e5f5c21a-baeb-4eb9-a75d-6708e215fa4b service nova] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:06:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-changed-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:34 user nova-compute[75073]: DEBUG nova.compute.manager [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing instance network info cache due to event network-changed-28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:06:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:06:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:06:34 user nova-compute[75073]: DEBUG nova.network.neutron [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated VIF entry in instance network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ec7e9bd3-b2bd-465c-befa-67a31f8e3299 req-f87844e4-114b-4ee5-baf5-f38f66df8cef service nova] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:35 user nova-compute[75073]: INFO nova.compute.manager [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Rebooting instance
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:06:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:38 user nova-compute[75073]: DEBUG nova.compute.manager [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:38 user nova-compute[75073]: WARNING nova.compute.manager [req-925b42f1-ac3f-4236-832f-ee9db0afdfee req-b9a27445-2c62-48e9-b29f-93d0a5c9fbf7 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state active and task_state reboot_started.
Nov 24 11:06:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:38 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance shutdown successfully.
Nov 24 11:06:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:40 user nova-compute[75073]: WARNING nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state active and task_state reboot_started.
Nov 24 11:06:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:40 user nova-compute[75073]: WARNING nova.compute.manager [req-3cb02332-8b50-4669-a7e5-f93e64774a8b req-39f7ea76-6ca4-4a82-986d-040bdf1ad292 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state active and task_state reboot_started.
Nov 24 11:06:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance running successfully.
Nov 24 11:06:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance soft rebooted successfully.
Nov 24 11:06:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-bf5713c1-8cc0-465b-96ea-38d477dcc2fe tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 6.998s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:06:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:06:42 user nova-compute[75073]: WARNING nova.compute.manager [req-33273f98-8ae2-435d-8cb4-4f91349a2e9b req-9a73a797-3bf1-4d67-a8b8-5731a7695cf8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state active and task_state None.
Nov 24 11:06:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:06:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:06:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:07:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:07:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:07:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:07:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=25.139972686767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 11:07:16 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:07:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:07:21 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:07:22 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:07:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:07:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:07:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:07:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 11:07:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 11:07:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 11:07:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:07:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:07:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:07:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:08:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:08:15 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:08:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:08:16 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=25.137630462646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:08:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:08:23 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:08:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:08:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:08:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-changed-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG nova.compute.manager [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing instance network info cache due to event network-changed-28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated VIF entry in instance network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG nova.network.neutron [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:08:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d4bf1914-b433-4870-93ac-1ba29e040967 req-251731b8-ea1c-436b-bc18-be640424ce3e service nova] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-changed-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.compute.manager [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing instance network info cache due to event network-changed-28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] Acquiring lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] Acquired lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Refreshing network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:08:27 user nova-compute[75073]: INFO nova.compute.manager [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Detaching volume 02ff1b30-3fcb-4504-900b-bff2584da4e5
Nov 24 11:08:27 user nova-compute[75073]: INFO nova.virt.block_device [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Attempting to driver detach volume 02ff1b30-3fcb-4504-900b-bff2584da4e5 from mountpoint /dev/vdb
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Attempting to detach device vdb from instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:08:27 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:08:27 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:08:27 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:08:27 user nova-compute[75073]:   <serial>02ff1b30-3fcb-4504-900b-bff2584da4e5</serial>
Nov 24 11:08:27 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:08:27 user nova-compute[75073]: </disk>
Nov 24 11:08:27 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:08:27 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully detached device vdb from instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 from the persistent domain config.
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:08:27 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:08:27 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:08:27 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:08:27 user nova-compute[75073]:   <serial>02ff1b30-3fcb-4504-900b-bff2584da4e5</serial>
Nov 24 11:08:27 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:08:27 user nova-compute[75073]: </disk>
Nov 24 11:08:27 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updated VIF entry in instance network info cache for port 28308072-df1c-4129-bd1d-03063bb27d78. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG nova.network.neutron [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [{"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bd01d0ee-2600-4085-aa70-b9f6fe110d31 req-98999740-aebf-4954-822c-458b4cd80316 service nova] Releasing lock "refresh_cache-ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:08:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:08:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:08:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Triggering sync for uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 11:08:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:08:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:48 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 is timed out.
Nov 24 11:08:48 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully detached device vdb from instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 from the live domain config.
Nov 24 11:08:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjrqWXtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:08:48 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1601779-f07e-4a55-be9a-4b22abbbb3b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:08:48 user nova-compute[75073]: No targets found.
Nov 24 11:08:48 user nova-compute[75073]: iSNS:
Nov 24 11:08:48 user nova-compute[75073]: No targets found.
Nov 24 11:08:48 user nova-compute[75073]: STATIC:
Nov 24 11:08:48 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5
Nov 24 11:08:48 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:08:48 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:08:48 user nova-compute[75073]: FIRMWARE:
Nov 24 11:08:48 user nova-compute[75073]: No targets found.
Nov 24 11:08:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:08:48 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:08:48 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[38870635-fd03-4d35-bcb2-bd41f5de72e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecdd6b-a6d3-4642-8b3d-15b315610dcd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)
Nov 24 11:08:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 (non-flash)
Nov 24 11:08:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2147a3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[015b9318-8162-4fe5-9675-b555d80d202b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d914e-bb93-46df-9867-9a0f111a292f]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6208f45-5c80-4a25-af16-575230dd5c1c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1939d176-56d8-4270-810c-b7782b4a1fb3]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc26a3d-4be4-4eb4-b480-9e66bf3a7719]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ad505c-19f1-41aa-8027-d3bcafde4746]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260]
Nov 24 11:08:48 user nova-compute[75073]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5, portal: 172.16.0.220,3260] successful.
Nov 24 11:08:48 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02ff1b30-3fcb-4504-900b-bff2584da4e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea250014-ff2e-4903-a8f7-13d1318d37b3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] <== disconnect_volume: return (263ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:08:48 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:08:49 user nova-compute[75073]: DEBUG nova.objects.instance [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'flavor' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:08:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-10ca3e03-ee8b-4849-8ac3-a9ef66099a0a tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:08:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.341s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:08:49 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:08:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:08:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:08 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:08 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:09:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:09:16 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:09:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:09:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=25.136856079101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:21 user nova-compute[75073]: INFO nova.compute.manager [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Terminating instance
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.compute.manager [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.compute.manager [req-ba37a18a-688f-499a-99e9-8f27c7758c3b req-ff29b069-be29-4daf-b536-c1a1ec646040 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-unplugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:21 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Instance destroyed successfully.
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lazy-loading 'resources' on Instance uuid ef2b46c1-3027-4036-80fa-bf48b6b8a0a8 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:04:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-516299369',display_name='tempest-TestMinimumBasicScenario-server-516299369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-516299369',id=50,image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyxvxGg2imGSTZLxSz/MozcuRTe/EIYIL/XLjBAkAN1+CG+s3RMqhNexcXRGPGzBr9NILsNWe04aTvAENRKRuFmlb4hxX9vVNy4z1WbmEoRPw494sKg27hcJzMINFmOzQ==',key_name='tempest-TestMinimumBasicScenario-58351296',keypairs=<?>,launch_index=0,launched_at=2023-11-24T11:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6bdb3d4520f44e084e0342e282bf315',ramdisk_id='',reservation_id='r-w0au8k1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='916ba4dd-61d9-4a8a-9859-c21b84dbd9aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1164257136',owner_user_name='tempest-TestMinimumBasicScenario-1164257136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:06:42Z,user_data=None,user_id='fe1d0ef3a4874771b1690ab4cd97fc2f',uuid=ef2b46c1-3027-4036-80fa-bf48b6b8a0a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converting VIF {"id": "28308072-df1c-4129-bd1d-03063bb27d78", "address": "fa:16:3e:5f:f5:41", "network": {"id": "f82f7899-ae53-45f9-a2ee-a168e7359292", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-155467640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6bdb3d4520f44e084e0342e282bf315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28308072-df", "ovs_interfaceid": "28308072-df1c-4129-bd1d-03063bb27d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:09:21 user nova-compute[75073]: DEBUG os_vif [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28308072-df, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b2346e-629d-4a4c-a63e-a87e8c773583) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:22 user nova-compute[75073]: INFO os_vif [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f5:41,bridge_name='br-int',has_traffic_filtering=True,id=28308072-df1c-4129-bd1d-03063bb27d78,network=Network(f82f7899-ae53-45f9-a2ee-a168e7359292),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28308072-df')
Nov 24 11:09:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Deleting instance files /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8_del
Nov 24 11:09:22 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Deletion of /opt/stack/data/nova/instances/ef2b46c1-3027-4036-80fa-bf48b6b8a0a8_del complete
Nov 24 11:09:22 user nova-compute[75073]: INFO nova.compute.manager [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 24 11:09:22 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:09:22 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Took 0.43 seconds to deallocate network for instance.
Nov 24 11:09:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.compute.manager [req-737a91e8-5b31-432d-b0a5-71a68944ff59 req-b54715fe-fce5-4f47-9f8b-d41af8f70b02 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-deleted-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:09:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:22 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Deleted allocations for instance ef2b46c1-3027-4036-80fa-bf48b6b8a0a8
Nov 24 11:09:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a5eab7ab-3bba-46f2-aceb-8099501b4cff tempest-TestMinimumBasicScenario-1164257136 tempest-TestMinimumBasicScenario-1164257136-project-member] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.652s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] Acquiring lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] Lock "ef2b46c1-3027-4036-80fa-bf48b6b8a0a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG nova.compute.manager [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] No waiting events found dispatching network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:09:23 user nova-compute[75073]: WARNING nova.compute.manager [req-cecb7e1d-6467-44f3-bc0a-1b3808d8a69c req-ece11688-10e9-4645-84e4-7eba643f5cb8 service nova] [instance: ef2b46c1-3027-4036-80fa-bf48b6b8a0a8] Received unexpected event network-vif-plugged-28308072-df1c-4129-bd1d-03063bb27d78 for instance with vm_state deleted and task_state None.
Nov 24 11:09:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:09:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:09:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:09:47 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:09:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:09:57 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:02 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:07 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:10 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:10 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:10:12 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:16 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:16 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:10:17 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=25.203773498535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:10:17 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:10:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:10:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:10:27 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:10:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:32 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:33 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 11:10:33 user nova-compute[75073]: INFO nova.compute.claims [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Claim successful on node user
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 11:10:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.policy [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4eab554219bf436a9263bd747cc00eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6498dc60b34e88bb0b10f8861885ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 11:10:34 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Creating image(s)
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "/opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "/opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "/opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.165s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk 1073741824" returned: 0 in 0.045s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Successfully created port: 3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.204s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 11:10:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Cannot resize image /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Ensure instance console log exists: /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Successfully updated port: 3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-changed-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.compute.manager [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing instance network info cache due to event network-changed-3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Instance network_info: |[{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Start _get_guest_xml network_info=[{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:10:35 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:10:35 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-128707294',display_name='tempest-TestStampPattern-server-128707294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-128707294',id=51,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-c7nxhrov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:10:34Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=da33b919-547d-40a1-8f4c-1a5869dec082,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'pci_devices' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:10:35 user nova-compute[75073]:   <uuid>da33b919-547d-40a1-8f4c-1a5869dec082</uuid>
Nov 24 11:10:35 user nova-compute[75073]:   <name>instance-00000033</name>
Nov 24 11:10:35 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:10:35 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:10:35 user nova-compute[75073]:   <metadata>
Nov 24 11:10:35 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:10:35 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:name>tempest-TestStampPattern-server-128707294</nova:name>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:10:35</nova:creationTime>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:10:35 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:10:35 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:owner>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:user uuid="4eab554219bf436a9263bd747cc00eae">tempest-TestStampPattern-672751644-project-member</nova:user>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:project uuid="6b6498dc60b34e88bb0b10f8861885ed">tempest-TestStampPattern-672751644</nova:project>
Nov 24 11:10:35 user nova-compute[75073]:       </nova:owner>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 11:10:35 user nova-compute[75073]:       <nova:ports>
Nov 24 11:10:35 user nova-compute[75073]:         <nova:port uuid="3010ec90-0616-4019-a9c5-f092091198fb">
Nov 24 11:10:35 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 11:10:35 user nova-compute[75073]:         </nova:port>
Nov 24 11:10:35 user nova-compute[75073]:       </nova:ports>
Nov 24 11:10:35 user nova-compute[75073]:     </nova:instance>
Nov 24 11:10:35 user nova-compute[75073]:   </metadata>
Nov 24 11:10:35 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:10:35 user nova-compute[75073]:     <system>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="serial">da33b919-547d-40a1-8f4c-1a5869dec082</entry>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="uuid">da33b919-547d-40a1-8f4c-1a5869dec082</entry>
Nov 24 11:10:35 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:10:35 user nova-compute[75073]:     </system>
Nov 24 11:10:35 user nova-compute[75073]:   </sysinfo>
Nov 24 11:10:35 user nova-compute[75073]:   <os>
Nov 24 11:10:35 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:10:35 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:10:35 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:10:35 user nova-compute[75073]:   </os>
Nov 24 11:10:35 user nova-compute[75073]:   <features>
Nov 24 11:10:35 user nova-compute[75073]:     <acpi/>
Nov 24 11:10:35 user nova-compute[75073]:     <apic/>
Nov 24 11:10:35 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:10:35 user nova-compute[75073]:   </features>
Nov 24 11:10:35 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:10:35 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:10:35 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:10:35 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:10:35 user nova-compute[75073]:   </clock>
Nov 24 11:10:35 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:10:35 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:10:35 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:10:35 user nova-compute[75073]:   </cpu>
Nov 24 11:10:35 user nova-compute[75073]:   <devices>
Nov 24 11:10:35 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:10:35 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:10:35 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk"/>
Nov 24 11:10:35 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:10:35 user nova-compute[75073]:     </disk>
Nov 24 11:10:35 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:10:35 user nova-compute[75073]:       <mac address="fa:16:3e:76:0b:0d"/>
Nov 24 11:10:35 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:10:35 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:10:35 user nova-compute[75073]:       <target dev="tap3010ec90-06"/>
Nov 24 11:10:35 user nova-compute[75073]:     </interface>
Nov 24 11:10:35 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:10:35 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/console.log" append="off"/>
Nov 24 11:10:35 user nova-compute[75073]:     </serial>
Nov 24 11:10:35 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:10:35 user nova-compute[75073]:     <video>
Nov 24 11:10:35 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:10:35 user nova-compute[75073]:     </video>
Nov 24 11:10:35 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:10:35 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:10:35 user nova-compute[75073]:     </rng>
Nov 24 11:10:35 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:10:35 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:10:35 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:10:35 user nova-compute[75073]:     </memballoon>
Nov 24 11:10:35 user nova-compute[75073]:   </devices>
Nov 24 11:10:35 user nova-compute[75073]: </domain>
Nov 24 11:10:35 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-128707294',display_name='tempest-TestStampPattern-server-128707294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-128707294',id=51,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-c7nxhrov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:10:34Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=da33b919-547d-40a1-8f4c-1a5869dec082,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG os_vif [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c7865e3-6bec-5804-a391-8b7573479546', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3010ec90-06, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3010ec90-06, col_values=(('qos', UUID('ac411f77-99b9-457c-8a5f-eb9cf12ba5e7')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3010ec90-06, col_values=(('external_ids', {'iface-id': '3010ec90-0616-4019-a9c5-f092091198fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:0b:0d', 'vm-uuid': 'da33b919-547d-40a1-8f4c-1a5869dec082'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:35 user nova-compute[75073]: INFO os_vif [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06')
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:10:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No VIF found with MAC fa:16:3e:76:0b:0d, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:10:36 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated VIF entry in instance network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:10:36 user nova-compute[75073]: DEBUG nova.network.neutron [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:10:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-1c7c893f-9266-4062-a211-e1ffcc08ed28 req-141b637b-3eb0-476e-bbef-c96ea27841d0 service nova] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG nova.compute.manager [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] No waiting events found dispatching network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:10:37 user nova-compute[75073]: WARNING nova.compute.manager [req-f92bd20b-3653-434d-b69e-d7af89eac180 req-466aec39-9f6e-4f1e-9e6a-f6f714c130f9 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received unexpected event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb for instance with vm_state building and task_state spawning.
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:37 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 11:10:39 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Instance spawned successfully.
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:10:39 user nova-compute[75073]: INFO nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] No waiting events found dispatching network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:10:39 user nova-compute[75073]: WARNING nova.compute.manager [req-0d524ee3-aedd-45be-b91f-dbfcedae544c req-5b577bc2-cb2b-4ee2-9b66-862d77d25618 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received unexpected event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb for instance with vm_state active and task_state None.
Nov 24 11:10:39 user nova-compute[75073]: INFO nova.compute.manager [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Took 5.95 seconds to build instance.
Nov 24 11:10:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3e5d9ea6-6319-4c54-8ed1-e11d2147cdda tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.077s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:10:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:10:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:10:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:12 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:11:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:11:18 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:11:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:11:19 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.17315673828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:11:19 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:11:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:11:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:11:24 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:11:25 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:11:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:11:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:11:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:11:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:11:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:11:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:12:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:12:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:12:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:21 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:12:21 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.172626495361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:12:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:12:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-changed-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.compute.manager [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing instance network info cache due to event network-changed-3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.network.neutron [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.objects.instance [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.network.neutron [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated VIF entry in instance network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG nova.network.neutron [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-43c537f5-eb11-4d40-8400-d6791c7f90dd req-f2ccaeb8-ef78-4cc4-9286-50c3d013cd44 service nova] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:12:25 user nova-compute[75073]: INFO nova.compute.manager [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Attaching volume f1fd8f3e-ce31-4348-99d2-7eb060176ab6 to /dev/vdb
Nov 24 11:12:25 user nova-compute[75073]: DEBUG os_brick.utils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e0b8c5-d138-45ef-83b4-04de4b1b5e22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec2e82-7323-4563-ace0-146d07a07b9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0801643f-6c7b-4c0f-84b8-52392399b4a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[93beb5fb-7d2e-4438-aebe-b094e05caa24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:12:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:12:26 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4fb0c1-2451-4ab5-98db-59cb2bb65342]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG os_brick.utils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating existing volume attachment record: 05e1bfb1-9fc9-4145-b855-c65881361450 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:12:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:12:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:12:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:12:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:12:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzbJiWLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:12:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:12:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:12:31 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ddffc-298d-4a1d-99af-2a860ad0c01a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:12:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6456bda-8675-42dc-b133-c56cddbb96d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6] added
Nov 24 11:12:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb9903-2304-4040-84fc-fe39e0563666]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c906a-8847-4100-a65f-cf5957d9c259]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzbJiWLn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzbJiWLn" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfcd08f-c62a-4318-8765-4846e74baf48]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vzbJiWLn'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0c654-a248-4386-b8d3-e743ec1e2544]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f761215-0fe7-4dd0-9084-028604ef93b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:12:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:12:31 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:12:31 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:12:31 user nova-compute[75073]: 
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfffaa4-7a54-4933-afd6-a437c5f588aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260]
Nov 24 11:12:31 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260] successful.
Nov 24 11:12:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1155e-6336-49c5-8c88-bde2845124f2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[542281fe-b4c4-4035-a952-b92d78942157]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)
Nov 24 11:12:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:12:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)
Nov 24 11:12:31 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5365bda8-f220-4519-9d19-d5742cbc4bd5]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzbJiWLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:12:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26232643364656437', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232643364656437', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:12:33 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:12:33 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:12:33 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:12:33 user nova-compute[75073]:   <serial>f1fd8f3e-ce31-4348-99d2-7eb060176ab6</serial>
Nov 24 11:12:33 user nova-compute[75073]: </disk>
Nov 24 11:12:33 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No VIF found with MAC fa:16:3e:76:0b:0d, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:12:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-32fab79b-8569-4e0f-8022-e473a84bb8d9 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.748s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:12:36 user nova-compute[75073]: INFO nova.compute.manager [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Detaching volume f1fd8f3e-ce31-4348-99d2-7eb060176ab6
Nov 24 11:12:36 user nova-compute[75073]: INFO nova.virt.block_device [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Attempting to driver detach volume f1fd8f3e-ce31-4348-99d2-7eb060176ab6 from mountpoint /dev/vdb
Nov 24 11:12:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Attempting to detach device vdb from instance da33b919-547d-40a1-8f4c-1a5869dec082 from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:12:36 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:12:36 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:12:36 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:12:36 user nova-compute[75073]:   <serial>f1fd8f3e-ce31-4348-99d2-7eb060176ab6</serial>
Nov 24 11:12:36 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:12:36 user nova-compute[75073]: </disk>
Nov 24 11:12:36 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:12:36 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully detached device vdb from instance da33b919-547d-40a1-8f4c-1a5869dec082 from the persistent domain config.
Nov 24 11:12:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da33b919-547d-40a1-8f4c-1a5869dec082 from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:12:36 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:12:36 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:12:36 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:12:36 user nova-compute[75073]:   <serial>f1fd8f3e-ce31-4348-99d2-7eb060176ab6</serial>
Nov 24 11:12:36 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:12:36 user nova-compute[75073]: </disk>
Nov 24 11:12:36 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:12:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:12:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 11:12:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:46 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:12:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 11:12:47 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 11:12:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:12:56 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da33b919-547d-40a1-8f4c-1a5869dec082 is timed out.
Nov 24 11:12:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully detached device vdb from instance da33b919-547d-40a1-8f4c-1a5869dec082 from the live domain config.
Nov 24 11:12:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzbJiWLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:12:56 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc953470-474b-401f-a602-e61fb6c7f030]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:12:56 user nova-compute[75073]: No targets found.
Nov 24 11:12:56 user nova-compute[75073]: iSNS:
Nov 24 11:12:56 user nova-compute[75073]: No targets found.
Nov 24 11:12:56 user nova-compute[75073]: STATIC:
Nov 24 11:12:56 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6
Nov 24 11:12:56 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:12:56 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:12:56 user nova-compute[75073]: FIRMWARE:
Nov 24 11:12:56 user nova-compute[75073]: No targets found.
Nov 24 11:12:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:12:56 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:12:56 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[72921240-5e72-4781-a7cd-d4ccfaeb710d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb2fdb2-3896-4957-82c6-24b11bdd2baf]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)
Nov 24 11:12:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 (non-flash)
Nov 24 11:12:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb24a6bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef7946-e412-4828-8c37-89462927d29c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927dd75-fc01-4868-bc87-26a3419c0df8]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d769c55-085e-408c-abec-769fd3ef606d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[46637cf9-b68f-494a-8d05-388a8e21d2aa]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d591c-b60f-4ff4-be79-7a1357e8a9a1]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[42700b01-2858-4c4e-bc9b-d6637841270f]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260]
Nov 24 11:12:56 user nova-compute[75073]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6, portal: 172.16.0.220,3260] successful.
Nov 24 11:12:56 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1fd8f3e-ce31-4348-99d2-7eb060176ab6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf4a84-27b9-4b6f-b3e4-022d8eb0f9df]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== disconnect_volume: return (279ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:12:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:12:57 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:12:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3569fd0d-71ca-4ee0-9d4d-5ceda13c61b3 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.577s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:12:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:13:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:13:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:22 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:13:22 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.1715087890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:13:22 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:13:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:13:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:13:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:13:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:13:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:13:30 user nova-compute[75073]: INFO nova.compute.manager [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] instance snapshotting
Nov 24 11:13:30 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Beginning live snapshot process
Nov 24 11:13:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json -f qcow2 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926.delta 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926.delta 1073741824" returned: 0 in 0.048s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 11:13:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 11:13:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75073) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 11:13:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 11:13:32 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 11:13:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926.delta /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926.delta /opt/stack/data/nova/instances/snapshots/tmpqbfwpg5v/a22e747aa12f43579b40b5f581570926" returned: 0 in 0.449s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:33 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Snapshot extracted, beginning image upload
Nov 24 11:13:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:13:35 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Snapshot image upload complete
Nov 24 11:13:35 user nova-compute[75073]: INFO nova.compute.manager [None req-df34ea78-8118-468e-a733-d313a5195f9e tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Took 4.96 seconds to snapshot the instance on the hypervisor.
Nov 24 11:13:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 11:13:37 user nova-compute[75073]: INFO nova.compute.claims [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Claim successful on node user
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 11:13:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.policy [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4eab554219bf436a9263bd747cc00eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6498dc60b34e88bb0b10f8861885ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 11:13:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Creating image(s)
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "/opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "/opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.part --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Successfully created port: 89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG nova.virt.images [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] 2926c170-d84f-494a-859b-9fbf82f2a1ec was qcow2, converting to raw {{(pid=75073) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG nova.privsep.utils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75073) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 11:13:38 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.part /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.converted {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.part /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.converted" returned: 0 in 0.655s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.converted --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Successfully updated port: 89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.compute.manager [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing instance network info cache due to event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] Acquiring lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] Acquired lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing network info cache for port 89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-5b228943-e8dc-48dd-818f-b35ed247e5d6 req-3b5e81be-2487-481b-8136-b83289e852ad service nova] Releasing lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquired lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json" returned: 0 in 0.183s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec,backing_fmt=raw /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec,backing_fmt=raw /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk 1073741824" returned: 0 in 0.148s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "b9a0024fb2fe2446ef88220ebf289816cd86c8ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.network.neutron [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9a0024fb2fe2446ef88220ebf289816cd86c8ec --force-share --output=json" returned: 0 in 0.184s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Ensure instance console log exists: /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Releasing lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance network_info: |[{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Start _get_guest_xml network_info=[{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8d6052e092a69175a3ed8214969f4b6b',container_format='bare',created_at=2023-11-24T11:13:30Z,direct_url=<?>,disk_format='qcow2',id=2926c170-d84f-494a-859b-9fbf82f2a1ec,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1281179206',owner='6b6498dc60b34e88bb0b10f8861885ed',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-24T11:13:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '2926c170-d84f-494a-859b-9fbf82f2a1ec'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:13:40 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:13:40 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8d6052e092a69175a3ed8214969f4b6b',container_format='bare',created_at=2023-11-24T11:13:30Z,direct_url=<?>,disk_format='qcow2',id=2926c170-d84f-494a-859b-9fbf82f2a1ec,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1281179206',owner='6b6498dc60b34e88bb0b10f8861885ed',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-24T11:13:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-607142688',display_name='tempest-TestStampPattern-server-607142688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-607142688',id=52,image_ref='2926c170-d84f-494a-859b-9fbf82f2a1ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-h3r9mdlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da33b919-547d-40a1-8f4c-1a5869dec082',image_min_disk='1',image_min_ram='0',image_owner_id='6b6498dc60b34e88bb0b10f8861885ed',image_owner_project_name='tempest-TestStampPattern-672751644',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-672751644-project-member',image_user_id='4eab554219bf436a9263bd747cc00eae',network_allocated='True',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:13:38Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=fdf647d5-9dde-4545-a3e7-97de187ed31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'pci_devices' on Instance uuid fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:13:40 user nova-compute[75073]:   <uuid>fdf647d5-9dde-4545-a3e7-97de187ed31b</uuid>
Nov 24 11:13:40 user nova-compute[75073]:   <name>instance-00000034</name>
Nov 24 11:13:40 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:13:40 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:13:40 user nova-compute[75073]:   <metadata>
Nov 24 11:13:40 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:13:40 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:name>tempest-TestStampPattern-server-607142688</nova:name>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:13:40</nova:creationTime>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:13:40 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:13:40 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:owner>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:user uuid="4eab554219bf436a9263bd747cc00eae">tempest-TestStampPattern-672751644-project-member</nova:user>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:project uuid="6b6498dc60b34e88bb0b10f8861885ed">tempest-TestStampPattern-672751644</nova:project>
Nov 24 11:13:40 user nova-compute[75073]:       </nova:owner>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:root type="image" uuid="2926c170-d84f-494a-859b-9fbf82f2a1ec"/>
Nov 24 11:13:40 user nova-compute[75073]:       <nova:ports>
Nov 24 11:13:40 user nova-compute[75073]:         <nova:port uuid="89607a9d-d25c-45ab-ac3a-0e0dc0211798">
Nov 24 11:13:40 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 11:13:40 user nova-compute[75073]:         </nova:port>
Nov 24 11:13:40 user nova-compute[75073]:       </nova:ports>
Nov 24 11:13:40 user nova-compute[75073]:     </nova:instance>
Nov 24 11:13:40 user nova-compute[75073]:   </metadata>
Nov 24 11:13:40 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:13:40 user nova-compute[75073]:     <system>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="serial">fdf647d5-9dde-4545-a3e7-97de187ed31b</entry>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="uuid">fdf647d5-9dde-4545-a3e7-97de187ed31b</entry>
Nov 24 11:13:40 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:13:40 user nova-compute[75073]:     </system>
Nov 24 11:13:40 user nova-compute[75073]:   </sysinfo>
Nov 24 11:13:40 user nova-compute[75073]:   <os>
Nov 24 11:13:40 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:13:40 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:13:40 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:13:40 user nova-compute[75073]:   </os>
Nov 24 11:13:40 user nova-compute[75073]:   <features>
Nov 24 11:13:40 user nova-compute[75073]:     <acpi/>
Nov 24 11:13:40 user nova-compute[75073]:     <apic/>
Nov 24 11:13:40 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:13:40 user nova-compute[75073]:   </features>
Nov 24 11:13:40 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:13:40 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:13:40 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:13:40 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:13:40 user nova-compute[75073]:   </clock>
Nov 24 11:13:40 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:13:40 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:13:40 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:13:40 user nova-compute[75073]:   </cpu>
Nov 24 11:13:40 user nova-compute[75073]:   <devices>
Nov 24 11:13:40 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:13:40 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:13:40 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk"/>
Nov 24 11:13:40 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:13:40 user nova-compute[75073]:     </disk>
Nov 24 11:13:40 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:13:40 user nova-compute[75073]:       <mac address="fa:16:3e:63:fa:ec"/>
Nov 24 11:13:40 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:13:40 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:13:40 user nova-compute[75073]:       <target dev="tap89607a9d-d2"/>
Nov 24 11:13:40 user nova-compute[75073]:     </interface>
Nov 24 11:13:40 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:13:40 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/console.log" append="off"/>
Nov 24 11:13:40 user nova-compute[75073]:     </serial>
Nov 24 11:13:40 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:13:40 user nova-compute[75073]:     <video>
Nov 24 11:13:40 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:13:40 user nova-compute[75073]:     </video>
Nov 24 11:13:40 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:13:40 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:13:40 user nova-compute[75073]:     </rng>
Nov 24 11:13:40 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:13:40 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:13:40 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:13:40 user nova-compute[75073]:     </memballoon>
Nov 24 11:13:40 user nova-compute[75073]:   </devices>
Nov 24 11:13:40 user nova-compute[75073]: </domain>
Nov 24 11:13:40 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-607142688',display_name='tempest-TestStampPattern-server-607142688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-607142688',id=52,image_ref='2926c170-d84f-494a-859b-9fbf82f2a1ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-h3r9mdlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da33b919-547d-40a1-8f4c-1a5869dec082',image_min_disk='1',image_min_ram='0',image_owner_id='6b6498dc60b34e88bb0b10f8861885ed',image_owner_project_name='tempest-TestStampPattern-672751644',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-672751644-project-member',image_user_id='4eab554219bf436a9263bd747cc00eae',network_allocated='True',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:13:38Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=fdf647d5-9dde-4545-a3e7-97de187ed31b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG os_vif [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67cb8414-8487-5508-8088-3ef600a9369e', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89607a9d-d2, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89607a9d-d2, col_values=(('qos', UUID('244d100b-386c-46b9-9c8c-230172fa8989')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89607a9d-d2, col_values=(('external_ids', {'iface-id': '89607a9d-d25c-45ab-ac3a-0e0dc0211798', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:fa:ec', 'vm-uuid': 'fdf647d5-9dde-4545-a3e7-97de187ed31b'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:40 user nova-compute[75073]: INFO os_vif [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2')
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:13:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No VIF found with MAC fa:16:3e:63:fa:ec, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:13:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:13:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:42 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:42 user nova-compute[75073]: DEBUG nova.compute.manager [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:13:42 user nova-compute[75073]: WARNING nova.compute.manager [req-c04f8e40-090f-42f0-a387-06740ceac718 req-aacfab51-e8b6-4e88-b795-5d3d46f54589 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received unexpected event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with vm_state building and task_state spawning.
Nov 24 11:13:42 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 11:13:43 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance spawned successfully.
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:13:43 user nova-compute[75073]: INFO nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 24 11:13:43 user nova-compute[75073]: DEBUG nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:13:44 user nova-compute[75073]: INFO nova.compute.manager [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Took 6.88 seconds to build instance.
Nov 24 11:13:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:13:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:13:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:13:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:44 user nova-compute[75073]: DEBUG nova.compute.manager [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:13:44 user nova-compute[75073]: WARNING nova.compute.manager [req-74f494ca-2139-492f-b9b2-019e17b8584e req-d29ba288-9f17-4692-806f-d6c896149bc4 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received unexpected event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with vm_state active and task_state None.
Nov 24 11:13:44 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-ddb5e1ad-d31c-4858-8098-a02b8b93d98c tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.974s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:13:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:13:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:13:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:14 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:14:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:21 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:14:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:14:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:14:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:14:24 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8871MB free_disk=25.017627716064453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:14:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fdf647d5-9dde-4545-a3e7-97de187ed31b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:14:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:14:26 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:14:27 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:14:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:14:27 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:14:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:14:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:14:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:14:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:15 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:15:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:15:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:15:24 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.016918182373047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:15:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fdf647d5-9dde-4545-a3e7-97de187ed31b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:15:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:15:28 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.compute.manager [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing instance network info cache due to event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] Acquiring lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] Acquired lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing network info cache for port 89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updated VIF entry in instance network info cache for port 89607a9d-d25c-45ab-ac3a-0e0dc0211798. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:15:29 user nova-compute[75073]: INFO nova.compute.manager [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Attaching volume c6581f4b-9a33-430d-a88e-21dd3fdd4474 to /dev/vdb
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9962d2f6-81fb-46f4-8881-fc600dd63007 req-39781337-6415-4d2b-8942-94a3328e16cb service nova] Releasing lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.utils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d16f9-7d51-42d9-b9f8-08c08107c731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[745720fe-28a4-4e3b-8ece-975c5e1856b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0c93b-44d9-4b54-8f19-cb6b78a03db2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5b473-fd91-4358-b85a-1f3e0798f2dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:15:29 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:15:29 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb2e4b-3689-40ef-9db7-476ecc178404]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG os_brick.utils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:15:29 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating existing volume attachment record: c2c5eab4-daa5-40fa-a364-44f2e0e7a0dd {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:15:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoTzvbyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:15:35 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:15:35 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:15:35 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7e1f8-caa8-4896-a44d-a12fe404e48f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:15:35 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55216da-721f-4032-b76d-cc17f3fc3aa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474] added
Nov 24 11:15:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea6e89-9f40-466d-aec1-622412ff3533]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a317967-8d33-47a9-a2d6-a5271741067b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoTzvbyB {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoTzvbyB" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5442c229-f7ef-419e-b0e3-da3e54cfb801]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoTzvbyB'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadc5b5-a567-462b-aa90-9db4796dbdb7]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68fb63-e82a-438c-ae21-c31c324b7b19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:15:35 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:15:35 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:15:35 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:15:35 user nova-compute[75073]: 
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0ed1c-aa85-4544-98b3-fea7533327cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260]
Nov 24 11:15:35 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260] successful.
Nov 24 11:15:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aca8fa-3e60-46c0-8f0a-45dbcd536a06]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8dcede-8be8-4685-8f3d-fb03390f89b6]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)
Nov 24 11:15:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)
Nov 24 11:15:35 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14dc388-7967-4ad1-b1bc-aa9783e8f0de]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:15:35 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoTzvbyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23132363833336133', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132363833336133', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:15:36 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:15:36 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:15:36 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:15:36 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:15:36 user nova-compute[75073]:   <serial>c6581f4b-9a33-430d-a88e-21dd3fdd4474</serial>
Nov 24 11:15:36 user nova-compute[75073]: </disk>
Nov 24 11:15:36 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:15:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:15:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:15:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] No VIF found with MAC fa:16:3e:63:fa:ec, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:15:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-a89063a3-636c-4150-9103-b8648704da0f tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.830s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:15:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:15:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:15:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:15:39 user nova-compute[75073]: INFO nova.compute.manager [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Detaching volume c6581f4b-9a33-430d-a88e-21dd3fdd4474
Nov 24 11:15:39 user nova-compute[75073]: INFO nova.virt.block_device [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Attempting to driver detach volume c6581f4b-9a33-430d-a88e-21dd3fdd4474 from mountpoint /dev/vdb
Nov 24 11:15:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Attempting to detach device vdb from instance fdf647d5-9dde-4545-a3e7-97de187ed31b from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:15:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:15:39 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:15:39 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:15:39 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:15:39 user nova-compute[75073]:   <serial>c6581f4b-9a33-430d-a88e-21dd3fdd4474</serial>
Nov 24 11:15:39 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:15:39 user nova-compute[75073]: </disk>
Nov 24 11:15:39 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:15:39 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully detached device vdb from instance fdf647d5-9dde-4545-a3e7-97de187ed31b from the persistent domain config.
Nov 24 11:15:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdf647d5-9dde-4545-a3e7-97de187ed31b from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:15:39 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:15:39 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:15:39 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:15:39 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:15:39 user nova-compute[75073]:   <serial>c6581f4b-9a33-430d-a88e-21dd3fdd4474</serial>
Nov 24 11:15:39 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:15:39 user nova-compute[75073]: </disk>
Nov 24 11:15:39 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:15:40 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:15:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:15:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:00 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdf647d5-9dde-4545-a3e7-97de187ed31b is timed out.
Nov 24 11:16:00 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully detached device vdb from instance fdf647d5-9dde-4545-a3e7-97de187ed31b from the live domain config.
Nov 24 11:16:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoTzvbyB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:16:00 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fdcf40-6003-4ed7-be46-f471ba930f94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:16:00 user nova-compute[75073]: No targets found.
Nov 24 11:16:00 user nova-compute[75073]: iSNS:
Nov 24 11:16:00 user nova-compute[75073]: No targets found.
Nov 24 11:16:00 user nova-compute[75073]: STATIC:
Nov 24 11:16:00 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474
Nov 24 11:16:00 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:16:00 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:16:00 user nova-compute[75073]: FIRMWARE:
Nov 24 11:16:00 user nova-compute[75073]: No targets found.
Nov 24 11:16:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:16:00 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:16:00 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5607bd51-717d-4488-add2-ee5fddddfa15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2d4645-81b8-4418-99b5-dc9973591ce0]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)
Nov 24 11:16:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 (non-flash)
Nov 24 11:16:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2147cc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[06397073-63ad-429b-8626-405f23bd4235]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c56841a-c9bc-44b2-a499-b81cff24fcca]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bdfc49-b232-4494-a758-339ae19fab23]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[232a5fd3-3ec2-49a9-8bfd-399aa7c29d23]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5bdb8-bcd0-4701-a4a1-93ffd29c399c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a26f0a-3c01-4e85-9790-d261eb245476]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260]
Nov 24 11:16:00 user nova-compute[75073]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474, portal: 172.16.0.220,3260] successful.
Nov 24 11:16:00 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6581f4b-9a33-430d-a88e-21dd3fdd4474 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ca7f62-3f80-4b39-8687-68fb4ee0cbba]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] <== disconnect_volume: return (277ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:16:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:01 user nova-compute[75073]: DEBUG nova.objects.instance [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'flavor' on Instance uuid fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:16:01 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-03dd8550-6ec0-43c0-8b7c-34ff60744009 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:16:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:16:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:16:23 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:16:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:16:24 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:16:24 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.015777587890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance fdf647d5-9dde-4545-a3e7-97de187ed31b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:16:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG nova.compute.manager [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing instance network info cache due to event network-changed-89607a9d-d25c-45ab-ac3a-0e0dc0211798. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] Acquiring lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] Acquired lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG nova.network.neutron [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Refreshing network info cache for port 89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:30 user nova-compute[75073]: INFO nova.compute.manager [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Terminating instance
Nov 24 11:16:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-unplugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-unplugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-0a7f166d-d045-4b4a-8e14-cd3fff832f8e req-eeb39cf2-70ec-4451-be4c-8f5bc8164a48 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-unplugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.network.neutron [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updated VIF entry in instance network info cache for port 89607a9d-d25c-45ab-ac3a-0e0dc0211798. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.network.neutron [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [{"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-9bc83566-b5e2-42e6-85f1-8e89d7994c1b req-873a09b7-7824-4e5c-bcd8-50b2c237c5b2 service nova] Releasing lock "refresh_cache-fdf647d5-9dde-4545-a3e7-97de187ed31b" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Instance destroyed successfully.
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'resources' on Instance uuid fdf647d5-9dde-4545-a3e7-97de187ed31b {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-607142688',display_name='tempest-TestStampPattern-server-607142688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-607142688',id=52,image_ref='2926c170-d84f-494a-859b-9fbf82f2a1ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=<?>,launch_index=0,launched_at=2023-11-24T11:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-h3r9mdlq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da33b919-547d-40a1-8f4c-1a5869dec082',image_min_disk='1',image_min_ram='0',image_owner_id='6b6498dc60b34e88bb0b10f8861885ed',image_owner_project_name='tempest-TestStampPattern-672751644',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-672751644-project-member',image_user_id='4eab554219bf436a9263bd747cc00eae',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:13:44Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=fdf647d5-9dde-4545-a3e7-97de187ed31b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "address": "fa:16:3e:63:fa:ec", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89607a9d-d2", "ovs_interfaceid": "89607a9d-d25c-45ab-ac3a-0e0dc0211798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG os_vif [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89607a9d-d2, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=244d100b-386c-46b9-9c8c-230172fa8989) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:31 user nova-compute[75073]: INFO os_vif [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=89607a9d-d25c-45ab-ac3a-0e0dc0211798,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89607a9d-d2')
Nov 24 11:16:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Deleting instance files /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b_del
Nov 24 11:16:31 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Deletion of /opt/stack/data/nova/instances/fdf647d5-9dde-4545-a3e7-97de187ed31b_del complete
Nov 24 11:16:31 user nova-compute[75073]: INFO nova.compute.manager [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:32 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:16:32 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Took 0.67 seconds to deallocate network for instance.
Nov 24 11:16:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:16:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:16:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:32 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Deleted allocations for instance fdf647d5-9dde-4545-a3e7-97de187ed31b
Nov 24 11:16:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c9272235-318e-43b4-ac6c-a40a6d1ed870 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:16:33 user nova-compute[75073]: WARNING nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received unexpected event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with vm_state deleted and task_state None.
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:16:33 user nova-compute[75073]: WARNING nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received unexpected event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with vm_state deleted and task_state None.
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Acquiring lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] Lock "fdf647d5-9dde-4545-a3e7-97de187ed31b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] No waiting events found dispatching network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:16:33 user nova-compute[75073]: WARNING nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received unexpected event network-vif-plugged-89607a9d-d25c-45ab-ac3a-0e0dc0211798 for instance with vm_state deleted and task_state None.
Nov 24 11:16:33 user nova-compute[75073]: DEBUG nova.compute.manager [req-c9814107-db28-4fd4-be3b-cce3e4e2c397 req-ec27f6d3-a987-40d9-bc60-45d0778e6055 service nova] [instance: fdf647d5-9dde-4545-a3e7-97de187ed31b] Received event network-vif-deleted-89607a9d-d25c-45ab-ac3a-0e0dc0211798 {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:16:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:16:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:16:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:16:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:17 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:17 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:17:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:17:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:26 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:17:26 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.113811492919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance da33b919-547d-40a1-8f4c-1a5869dec082 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:17:26 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-changed-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing instance network info cache due to event network-changed-3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] Acquiring lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] Acquired lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.network.neutron [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Refreshing network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:28 user nova-compute[75073]: INFO nova.compute.manager [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Terminating instance
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-unplugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] No waiting events found dispatching network-vif-unplugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:17:28 user nova-compute[75073]: DEBUG nova.compute.manager [req-d458a057-aaa5-479b-b7d1-2adef10d71d0 req-cef18178-230d-435d-a9ba-9df672e8c25e service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-unplugged-3010ec90-0616-4019-a9c5-f092091198fb for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updated VIF entry in instance network info cache for port 3010ec90-0616-4019-a9c5-f092091198fb. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.neutron [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [{"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-ccc8ca07-7158-45f7-8844-c6bd8d84be19 req-f82b2359-ce34-44b5-9e05-6869a96179f7 service nova] Releasing lock "refresh_cache-da33b919-547d-40a1-8f4c-1a5869dec082" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Instance destroyed successfully.
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.objects.instance [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lazy-loading 'resources' on Instance uuid da33b919-547d-40a1-8f4c-1a5869dec082 {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:10:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-128707294',display_name='tempest-TestStampPattern-server-128707294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-128707294',id=51,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU+aLOZ5v6Dybr70W0+LKcocJIFKUDbGlQ9vE6IXgWifnla2A1lmNgJayA34bSCvLypulGk5ixJ8EZm1o/L05FIxk89OjtDBzavpB29SuAQJxzrRosMi9gRJ975Bvdkcw==',key_name='tempest-TestStampPattern-1690430781',keypairs=<?>,launch_index=0,launched_at=2023-11-24T11:10:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b6498dc60b34e88bb0b10f8861885ed',ramdisk_id='',reservation_id='r-c7nxhrov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-672751644',owner_user_name='tempest-TestStampPattern-672751644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:13:36Z,user_data=None,user_id='4eab554219bf436a9263bd747cc00eae',uuid=da33b919-547d-40a1-8f4c-1a5869dec082,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converting VIF {"id": "3010ec90-0616-4019-a9c5-f092091198fb", "address": "fa:16:3e:76:0b:0d", "network": {"id": "d8d672ca-dc1a-4005-866a-5ff0247f5bf4", "bridge": "br-int", "label": "tempest-TestStampPattern-2088577615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b6498dc60b34e88bb0b10f8861885ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3010ec90-06", "ovs_interfaceid": "3010ec90-0616-4019-a9c5-f092091198fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG os_vif [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3010ec90-06, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac411f77-99b9-457c-8a5f-eb9cf12ba5e7) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:29 user nova-compute[75073]: INFO os_vif [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:0b:0d,bridge_name='br-int',has_traffic_filtering=True,id=3010ec90-0616-4019-a9c5-f092091198fb,network=Network(d8d672ca-dc1a-4005-866a-5ff0247f5bf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3010ec90-06')
Nov 24 11:17:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Deleting instance files /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082_del
Nov 24 11:17:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Deletion of /opt/stack/data/nova/instances/da33b919-547d-40a1-8f4c-1a5869dec082_del complete
Nov 24 11:17:29 user nova-compute[75073]: INFO nova.compute.manager [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:17:29 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Took 0.40 seconds to deallocate network for instance.
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:30 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Deleted allocations for instance da33b919-547d-40a1-8f4c-1a5869dec082
Nov 24 11:17:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-606c7fee-c83a-4ff9-a5ea-7c47071ca6c4 tempest-TestStampPattern-672751644 tempest-TestStampPattern-672751644-project-member] Lock "da33b919-547d-40a1-8f4c-1a5869dec082" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.602s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:17:30 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:17:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:17:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] Acquiring lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:17:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:17:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] Lock "da33b919-547d-40a1-8f4c-1a5869dec082-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:17:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] No waiting events found dispatching network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:17:31 user nova-compute[75073]: WARNING nova.compute.manager [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received unexpected event network-vif-plugged-3010ec90-0616-4019-a9c5-f092091198fb for instance with vm_state deleted and task_state None.
Nov 24 11:17:31 user nova-compute[75073]: DEBUG nova.compute.manager [req-eac00162-183c-4079-91f3-45d2a7c73854 req-2d54623c-e53a-4057-804f-f65bb82def93 service nova] [instance: da33b919-547d-40a1-8f4c-1a5869dec082] Received event network-vif-deleted-3010ec90-0616-4019-a9c5-f092091198fb {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:17:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:17:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 11:17:49 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 11:17:51 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:51 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 11:17:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:17:57 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:17:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:18:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:18 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:18:19 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:22 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:18:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:18:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:18:27 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:18:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=25.14059066772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:18:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:18:29 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:18:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:18:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:18:34 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:18:39 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:18:44 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:54 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:18:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:58 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:18:59 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:04 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:09 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Starting instance... {{(pid=75073) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75073) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 11:19:12 user nova-compute[75073]: INFO nova.compute.claims [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Claim successful on node user
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Start building networks asynchronously for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Allocating IP information in the background. {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] allocate_for_instance() {{(pid=75073) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 11:19:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Start building block device mappings for instance. {{(pid=75073) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Start spawning the instance on the hypervisor. {{(pid=75073) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Creating instance directory {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 11:19:12 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Creating image(s)
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "/opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "/opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:12 user nova-compute[75073]: DEBUG nova.policy [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4ea89046fa04bd69fcd5dad85568842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6effa9b0a3e4a12a92ba7c661a32e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75073) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.232s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk 1073741824 {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b,backing_fmt=raw /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk 1073741824" returned: 0 in 0.052s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "b62b8140a1c7c93494f8c511b15107d8e8aadd9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b62b8140a1c7c93494f8c511b15107d8e8aadd9b --force-share --output=json" returned: 0 in 0.171s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk. size=1073741824 {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Successfully created port: 8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG nova.virt.disk.api [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Cannot resize image /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk to a smaller size. {{(pid=75073) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Created local disks {{(pid=75073) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Ensure instance console log exists: /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/console.log {{(pid=75073) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:13 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Successfully updated port: 8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Building network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Instance cache missing network info. {{(pid=75073) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-changed-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.compute.manager [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Refreshing instance network info cache due to event network-changed-8f230c8c-b210-409f-a711-1291bfd7a91b. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.neutron [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Instance network_info: |[{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75073) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.neutron [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Refreshing network info cache for port 8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Start _get_guest_xml network_info=[{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'encrypted': False, 'image_id': '095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 11:19:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:19:14 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CPU controller missing on host. {{(pid=75073) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.host [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CPU controller found on host. {{(pid=75073) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75073) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T10:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T10:16:58Z,direct_url=<?>,disk_format='qcow2',id=095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1ffe23cbf8274b22b6c1d014d3fd0643',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T10:17:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flavor limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Image limits 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flavor pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Image pref 0:0:0 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Got 1 possible topologies {{(pid=75073) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.hardware [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75073) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-351764608',display_name='tempest-SnapshotDataIntegrityTests-server-351764608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-351764608',id=53,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnIAq6bhWIxchNC/gzl2TXcxHih07VE0VFXpVVVjTyOnlltDF4VWoVoDP0HNLL6a7mo409Nd7a0iasQKzuovAW60kh1do7NrayB5zTiTqdH7x/2LvBBvdwkrCKFpPCXw==',key_name='tempest-keypair-797396173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6effa9b0a3e4a12a92ba7c661a32e22',ramdisk_id='',reservation_id='r-numhke1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-419032671',owner_user_name='tempest-SnapshotDataIntegrityTests-419032671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4ea89046fa04bd69fcd5dad85568842',uuid=6ecbf57f-cf07-41e8-8cdf-9e84733f32bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75073) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converting VIF {"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] End _get_guest_xml xml=<domain type="kvm">
Nov 24 11:19:14 user nova-compute[75073]:   <uuid>6ecbf57f-cf07-41e8-8cdf-9e84733f32bf</uuid>
Nov 24 11:19:14 user nova-compute[75073]:   <name>instance-00000035</name>
Nov 24 11:19:14 user nova-compute[75073]:   <memory>524288</memory>
Nov 24 11:19:14 user nova-compute[75073]:   <vcpu>1</vcpu>
Nov 24 11:19:14 user nova-compute[75073]:   <metadata>
Nov 24 11:19:14 user nova-compute[75073]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 11:19:14 user nova-compute[75073]:       <nova:package version="0.0.0"/>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-351764608</nova:name>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:creationTime>2023-11-24 11:19:14</nova:creationTime>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:flavor name="m1.tiny">
Nov 24 11:19:14 user nova-compute[75073]:         <nova:memory>512</nova:memory>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:disk>1</nova:disk>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:swap>0</nova:swap>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:vcpus>1</nova:vcpus>
Nov 24 11:19:14 user nova-compute[75073]:       </nova:flavor>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:owner>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:user uuid="c4ea89046fa04bd69fcd5dad85568842">tempest-SnapshotDataIntegrityTests-419032671-project-member</nova:user>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:project uuid="b6effa9b0a3e4a12a92ba7c661a32e22">tempest-SnapshotDataIntegrityTests-419032671</nova:project>
Nov 24 11:19:14 user nova-compute[75073]:       </nova:owner>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:root type="image" uuid="095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604"/>
Nov 24 11:19:14 user nova-compute[75073]:       <nova:ports>
Nov 24 11:19:14 user nova-compute[75073]:         <nova:port uuid="8f230c8c-b210-409f-a711-1291bfd7a91b">
Nov 24 11:19:14 user nova-compute[75073]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 11:19:14 user nova-compute[75073]:         </nova:port>
Nov 24 11:19:14 user nova-compute[75073]:       </nova:ports>
Nov 24 11:19:14 user nova-compute[75073]:     </nova:instance>
Nov 24 11:19:14 user nova-compute[75073]:   </metadata>
Nov 24 11:19:14 user nova-compute[75073]:   <sysinfo type="smbios">
Nov 24 11:19:14 user nova-compute[75073]:     <system>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="product">OpenStack Nova</entry>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="version">0.0.0</entry>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="serial">6ecbf57f-cf07-41e8-8cdf-9e84733f32bf</entry>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="uuid">6ecbf57f-cf07-41e8-8cdf-9e84733f32bf</entry>
Nov 24 11:19:14 user nova-compute[75073]:       <entry name="family">Virtual Machine</entry>
Nov 24 11:19:14 user nova-compute[75073]:     </system>
Nov 24 11:19:14 user nova-compute[75073]:   </sysinfo>
Nov 24 11:19:14 user nova-compute[75073]:   <os>
Nov 24 11:19:14 user nova-compute[75073]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 11:19:14 user nova-compute[75073]:     <boot dev="hd"/>
Nov 24 11:19:14 user nova-compute[75073]:     <smbios mode="sysinfo"/>
Nov 24 11:19:14 user nova-compute[75073]:   </os>
Nov 24 11:19:14 user nova-compute[75073]:   <features>
Nov 24 11:19:14 user nova-compute[75073]:     <acpi/>
Nov 24 11:19:14 user nova-compute[75073]:     <apic/>
Nov 24 11:19:14 user nova-compute[75073]:     <vmcoreinfo/>
Nov 24 11:19:14 user nova-compute[75073]:   </features>
Nov 24 11:19:14 user nova-compute[75073]:   <clock offset="utc">
Nov 24 11:19:14 user nova-compute[75073]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 11:19:14 user nova-compute[75073]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 11:19:14 user nova-compute[75073]:     <timer name="hpet" present="no"/>
Nov 24 11:19:14 user nova-compute[75073]:   </clock>
Nov 24 11:19:14 user nova-compute[75073]:   <cpu mode="custom" match="exact">
Nov 24 11:19:14 user nova-compute[75073]:     <model>Nehalem</model>
Nov 24 11:19:14 user nova-compute[75073]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 11:19:14 user nova-compute[75073]:   </cpu>
Nov 24 11:19:14 user nova-compute[75073]:   <devices>
Nov 24 11:19:14 user nova-compute[75073]:     <disk type="file" device="disk">
Nov 24 11:19:14 user nova-compute[75073]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 11:19:14 user nova-compute[75073]:       <source file="/opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk"/>
Nov 24 11:19:14 user nova-compute[75073]:       <target dev="vda" bus="virtio"/>
Nov 24 11:19:14 user nova-compute[75073]:     </disk>
Nov 24 11:19:14 user nova-compute[75073]:     <interface type="ethernet">
Nov 24 11:19:14 user nova-compute[75073]:       <mac address="fa:16:3e:59:b7:0f"/>
Nov 24 11:19:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:19:14 user nova-compute[75073]:       <mtu size="1442"/>
Nov 24 11:19:14 user nova-compute[75073]:       <target dev="tap8f230c8c-b2"/>
Nov 24 11:19:14 user nova-compute[75073]:     </interface>
Nov 24 11:19:14 user nova-compute[75073]:     <serial type="pty">
Nov 24 11:19:14 user nova-compute[75073]:       <log file="/opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/console.log" append="off"/>
Nov 24 11:19:14 user nova-compute[75073]:     </serial>
Nov 24 11:19:14 user nova-compute[75073]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 11:19:14 user nova-compute[75073]:     <video>
Nov 24 11:19:14 user nova-compute[75073]:       <model type="virtio"/>
Nov 24 11:19:14 user nova-compute[75073]:     </video>
Nov 24 11:19:14 user nova-compute[75073]:     <rng model="virtio">
Nov 24 11:19:14 user nova-compute[75073]:       <backend model="random">/dev/urandom</backend>
Nov 24 11:19:14 user nova-compute[75073]:     </rng>
Nov 24 11:19:14 user nova-compute[75073]:     <controller type="usb" index="0" model="none"/>
Nov 24 11:19:14 user nova-compute[75073]:     <memballoon model="virtio">
Nov 24 11:19:14 user nova-compute[75073]:       <stats period="10"/>
Nov 24 11:19:14 user nova-compute[75073]:     </memballoon>
Nov 24 11:19:14 user nova-compute[75073]:   </devices>
Nov 24 11:19:14 user nova-compute[75073]: </domain>
Nov 24 11:19:14 user nova-compute[75073]:  {{(pid=75073) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-351764608',display_name='tempest-SnapshotDataIntegrityTests-server-351764608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-351764608',id=53,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnIAq6bhWIxchNC/gzl2TXcxHih07VE0VFXpVVVjTyOnlltDF4VWoVoDP0HNLL6a7mo409Nd7a0iasQKzuovAW60kh1do7NrayB5zTiTqdH7x/2LvBBvdwkrCKFpPCXw==',key_name='tempest-keypair-797396173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6effa9b0a3e4a12a92ba7c661a32e22',ramdisk_id='',reservation_id='r-numhke1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-419032671',owner_user_name='tempest-SnapshotDataIntegrityTests-419032671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T11:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4ea89046fa04bd69fcd5dad85568842',uuid=6ecbf57f-cf07-41e8-8cdf-9e84733f32bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converting VIF {"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG os_vif [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2') {{(pid=75073) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6c31898-f1c5-509e-99da-49e5c4291cd2', '_type': 'linux-noop'}}, row=False) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f230c8c-b2, may_exist=True, interface_attrs={}) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f230c8c-b2, col_values=(('qos', UUID('5c2e249e-1d0f-4bd2-8fec-59e08184c0e6')),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f230c8c-b2, col_values=(('external_ids', {'iface-id': '8f230c8c-b210-409f-a711-1291bfd7a91b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b7:0f', 'vm-uuid': '6ecbf57f-cf07-41e8-8cdf-9e84733f32bf'}),), if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:19:14 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:15 user nova-compute[75073]: INFO os_vif [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2')
Nov 24 11:19:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No VIF found with MAC fa:16:3e:59:b7:0f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated VIF entry in instance network info cache for port 8f230c8c-b210-409f-a711-1291bfd7a91b. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG nova.network.neutron [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:19:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-d3859ca2-d7dc-48ff-b950-c1b027fcfdcb req-cb4e6122-4e7a-457e-894c-4899ba8d78db service nova] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:16 user nova-compute[75073]: DEBUG nova.compute.manager [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] No waiting events found dispatching network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:19:16 user nova-compute[75073]: WARNING nova.compute.manager [req-87001bd3-2049-4077-b7de-98b25943b04a req-ebad88e7-1a51-4316-b90b-f29c42e1e93c service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received unexpected event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b for instance with vm_state building and task_state spawning.
Nov 24 11:19:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:17 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Instance event wait completed in 0 seconds for  {{(pid=75073) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Guest created on hypervisor {{(pid=75073) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 11:19:18 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Instance spawned successfully.
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_cdrom_bus of ide {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_disk_bus of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_input_bus of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_pointer_model of None {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_video_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Found default for hw_vif_model of virtio {{(pid=75073) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.compute.manager [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] No waiting events found dispatching network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:19:18 user nova-compute[75073]: WARNING nova.compute.manager [req-bdc0808b-4608-42d8-9327-f1bf7e5d762d req-70dcd175-6aed-408a-990e-38b095cd2bcc service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received unexpected event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b for instance with vm_state building and task_state spawning.
Nov 24 11:19:18 user nova-compute[75073]: INFO nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 24 11:19:18 user nova-compute[75073]: DEBUG nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Checking state {{(pid=75073) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 11:19:18 user nova-compute[75073]: INFO nova.compute.manager [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Took 6.66 seconds to build instance.
Nov 24 11:19:18 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-873a6fe8-a281-4580-bcc0-d7b8b70eb7bb tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.785s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:19 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:19 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:19:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:24 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:24 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:19:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:19:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:19:28 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:19:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.12472152709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:19:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:19:29 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:19:29 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:19:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:19:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:19:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:19:32 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:19:33 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:19:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:19:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:19:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:19:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:44 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:19:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:48 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:19:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:20 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:20 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:20:28 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:20:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:20:29 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.095157623291016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:20:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:20:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:20:33 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:20:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:20:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:20:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:20:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:20:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:20:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:20:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-changed-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG nova.compute.manager [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Refreshing instance network info cache due to event network-changed-8f230c8c-b210-409f-a711-1291bfd7a91b. {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Refreshing network info cache for port 8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated VIF entry in instance network info cache for port 8f230c8c-b210-409f-a711-1291bfd7a91b. {{(pid=75073) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG nova.network.neutron [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:21:03 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-643c51bb-4347-400e-9ee8-df1f7a9d0796 req-be4fa145-77f9-48f3-9425-50aa8f86e922 service nova] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:21:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:21:07 user nova-compute[75073]: INFO nova.compute.manager [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attaching volume d4958802-d350-43bf-92b6-67030275655a to /dev/vdb
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[55774d92-c332-48e7-937e-e041894c8825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[120be923-5aa7-4ca1-9051-ac7b07ded6ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3307f80-b70b-40dc-ab16-64eddd6fa304]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[e709867e-8ab2-4d3c-b0d8-38a12040c372]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:21:07 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:21:07 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13802ff-6a6a-4ebb-8aff-5a77e43bccdc]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG os_brick.utils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:21:07 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating existing volume attachment record: 765c1a57-e6c8-46c2-9040-d4c850c45b6b {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:21:08 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wySxTvmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:21:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:21:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:21:13 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a215418-da8b-4258-9b2a-de69f02211e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:21:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[879008c7-a622-4c2e-9d3b-f3557148a2b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a] added
Nov 24 11:21:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f04cdd7-e4f3-4a79-812d-3df8357cbd9c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ce4e2-0f68-42a5-94a7-52015eda8fb2]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wySxTvmp {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wySxTvmp" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a76876-a014-4740-8f85-454089e0f303]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wySxTvmp'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[64923d50-dd24-4aff-8610-5ae4e4eadfe3]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f983a80-dd9c-4478-9cd2-ddc6c157a772]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:21:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:21:13 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:21:13 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:21:13 user nova-compute[75073]: 
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34d33f-6322-4c6c-be28-9ac47f205cc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260]
Nov 24 11:21:13 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260] successful.
Nov 24 11:21:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9cd60-6025-4339-b2f6-9c56c3d6ceb9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4d2717-5db4-4b7e-bd00-a04fa9689aa9]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)
Nov 24 11:21:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)
Nov 24 11:21:13 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec35fae-34ac-4d87-8436-bac83fe9143b]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:21:13 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wySxTvmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:21:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:21:14 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26638333566646238', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:21:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333566646238', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:21:14 user nova-compute[75073]: DEBUG nova.objects.instance [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:21:14 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:21:14 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:21:14 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:21:14 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:21:14 user nova-compute[75073]:   <serial>d4958802-d350-43bf-92b6-67030275655a</serial>
Nov 24 11:21:14 user nova-compute[75073]: </disk>
Nov 24 11:21:14 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:21:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:21:15 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No VIF found with MAC fa:16:3e:59:b7:0f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:21:15 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-3ea89918-e1b1-4bf3-8062-0f850b9b188e tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.849s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:21:18 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:22 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:22 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:21:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:21:29 user nova-compute[75073]: INFO nova.compute.manager [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Detaching volume d4958802-d350-43bf-92b6-67030275655a
Nov 24 11:21:29 user nova-compute[75073]: INFO nova.virt.block_device [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attempting to driver detach volume d4958802-d350-43bf-92b6-67030275655a from mountpoint /dev/vdb
Nov 24 11:21:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Attempting to detach device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:21:29 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:21:29 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:21:29 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:21:29 user nova-compute[75073]:   <serial>d4958802-d350-43bf-92b6-67030275655a</serial>
Nov 24 11:21:29 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:21:29 user nova-compute[75073]: </disk>
Nov 24 11:21:29 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:21:29 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config.
Nov 24 11:21:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:21:29 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:21:29 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:21:29 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:21:29 user nova-compute[75073]:   <serial>d4958802-d350-43bf-92b6-67030275655a</serial>
Nov 24 11:21:29 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:21:29 user nova-compute[75073]: </disk>
Nov 24 11:21:29 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:21:29 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:21:30 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:21:30 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.09390640258789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:21:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:21:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:21:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:21:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:21:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:21:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:39 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:21:50 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf is timed out.
Nov 24 11:21:50 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config.
Nov 24 11:21:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wySxTvmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:21:50 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[992765a8-4f33-491f-9e44-c25aebe4f621]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:21:50 user nova-compute[75073]: No targets found.
Nov 24 11:21:50 user nova-compute[75073]: iSNS:
Nov 24 11:21:50 user nova-compute[75073]: No targets found.
Nov 24 11:21:50 user nova-compute[75073]: STATIC:
Nov 24 11:21:50 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a
Nov 24 11:21:50 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:21:50 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:21:50 user nova-compute[75073]: FIRMWARE:
Nov 24 11:21:50 user nova-compute[75073]: No targets found.
Nov 24 11:21:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:21:50 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:21:50 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4547c750-2e11-450b-87cf-d597efbaec14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a3ba17-bc6e-481b-8d41-7509243b62bb]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)
Nov 24 11:21:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a (non-flash)
Nov 24 11:21:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb214755fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d942c0a-ebf0-4755-a006-e8b899dbe758]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e216f-f183-4d06-a523-e5076b547bd1]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cce962-d799-4815-908f-f144e7470331]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a54c4a-0341-41dc-af93-e7b045a5a1e4]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7395b6c-2cae-46b3-9d5c-0cdb89811a15]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c211ea-cdaf-45a8-9148-fbb2b3eeda98]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260]
Nov 24 11:21:50 user nova-compute[75073]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a, portal: 172.16.0.220,3260] successful.
Nov 24 11:21:50 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4958802-d350-43bf-92b6-67030275655a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d7f440-1143-471f-ad68-80c340633be6]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== disconnect_volume: return (280ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:21:50 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:21:51 user nova-compute[75073]: DEBUG nova.objects.instance [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:21:51 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-7a5403c3-2988-47da-ab8c-10007bfa7ae6 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:21:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:22:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:22:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:22:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG nova.objects.instance [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:22:21 user nova-compute[75073]: INFO nova.compute.manager [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attaching volume aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d to /dev/vdb
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b9062-af35-4b69-9956-dc9c5759c7b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb50cbe-3bbc-4ebc-951d-786b8fdb1559]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7ecd21-eee4-4bfc-8a36-7f1b064ea494]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6fc9c1-28c4-4cb7-a090-a2dd7edf7e71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:22:21 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:22:21 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7457af-38ea-45b8-b03b-585cf5141dae]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG os_brick.utils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:22:21 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating existing volume attachment record: ffc90f25-9632-4a10-b26e-df32053abaa7 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:22:23 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:22:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGgXThFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:22:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:22:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:22:27 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c99d2-4c28-4828-b7ba-aeaefece1297]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:22:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afba5f6-e448-42e1-97e4-984eec63f44b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d] added
Nov 24 11:22:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2632905-f5d8-4ada-8358-50ccf3a8d757]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[191eb026-3ec3-4a7c-97f6-fe1d7afd7b3f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGgXThFM {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGgXThFM" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e7c38-ef86-4ab1-bdbe-d4491dd56482]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGgXThFM'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4576541-25c1-4036-97bf-9822acebe904]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a4a57b-244d-4b12-a360-8b8df8940e4d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:22:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:22:27 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:22:27 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:22:27 user nova-compute[75073]: 
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cf30c9-4da5-4a9a-a290-16c88460b196]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260]
Nov 24 11:22:27 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260] successful.
Nov 24 11:22:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1f2e6-0b1f-4758-afb8-7531d4a59819]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c22a7-f38c-4f1a-9f4c-91f349692ba2]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)
Nov 24 11:22:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)
Nov 24 11:22:27 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6aeda4-6045-46be-b9bd-fed4fb47fe4e]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:27 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGgXThFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26132386266336132', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132386266336132', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG nova.objects.instance [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:22:28 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:22:28 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:22:28 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:22:28 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:22:28 user nova-compute[75073]:   <serial>aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d</serial>
Nov 24 11:22:28 user nova-compute[75073]: </disk>
Nov 24 11:22:28 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:22:29 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No VIF found with MAC fa:16:3e:59:b7:0f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:22:29 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-871e558e-4e54-47c6-9ce9-ca955b7e6743 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.652s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:22:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:22:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:22:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:31 user nova-compute[75073]: INFO nova.compute.manager [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Detaching volume aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d
Nov 24 11:22:31 user nova-compute[75073]: INFO nova.virt.block_device [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attempting to driver detach volume aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d from mountpoint /dev/vdb
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Attempting to detach device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:22:32 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:22:32 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:22:32 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:22:32 user nova-compute[75073]:   <serial>aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d</serial>
Nov 24 11:22:32 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:22:32 user nova-compute[75073]: </disk>
Nov 24 11:22:32 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:22:32 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config.
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:22:32 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:22:32 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:22:32 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:22:32 user nova-compute[75073]:   <serial>aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d</serial>
Nov 24 11:22:32 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:22:32 user nova-compute[75073]: </disk>
Nov 24 11:22:32 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75073) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:22:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:22:32 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.092952728271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing inventories for resource provider b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating ProviderTree inventory for provider b8421a5b-83de-4630-bf28-983e95daab87 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Updating inventory in ProviderTree for provider b8421a5b-83de-4630-bf28-983e95daab87 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing aggregate associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, aggregates: None {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Refreshing trait associations for resource provider b8421a5b-83de-4630-bf28-983e95daab87, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND {{(pid=75073) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:22:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:22:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:22:35 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:22:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:22:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:22:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:22:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:22:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:52 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf is timed out.
Nov 24 11:22:52 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config.
Nov 24 11:22:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGgXThFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:22:52 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd202604-f196-402f-9ce5-a8f790d1d22a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:22:52 user nova-compute[75073]: No targets found.
Nov 24 11:22:52 user nova-compute[75073]: iSNS:
Nov 24 11:22:52 user nova-compute[75073]: No targets found.
Nov 24 11:22:52 user nova-compute[75073]: STATIC:
Nov 24 11:22:52 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d
Nov 24 11:22:52 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:22:52 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:22:52 user nova-compute[75073]: FIRMWARE:
Nov 24 11:22:52 user nova-compute[75073]: No targets found.
Nov 24 11:22:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:22:52 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:22:52 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[33de5fce-765b-42db-940a-fe66fe46b470]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9372862-3876-4415-b1bf-731a63c7f59b]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)
Nov 24 11:22:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d (non-flash)
Nov 24 11:22:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23846c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da91464-372b-4c2e-873b-981ed11e82f6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[351fed2a-2b02-4c25-a209-f1c394deaf09]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2171ec-aef2-4012-8e83-fe45061d9744]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a440cc6-324d-42cc-8745-2b15166bc61f]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75073) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb6d6f-9471-481a-a3f2-6a95a734a226]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f41a85-3578-487c-8dad-c7fe87359d6b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260]
Nov 24 11:22:52 user nova-compute[75073]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d, portal: 172.16.0.220,3260] successful.
Nov 24 11:22:52 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa2ff7f2-13d2-4eab-a091-174ed5aa8d5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e18d2b-ebb6-402a-9433-fa5c1c5cbcfa]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== disconnect_volume: return (256ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:22:52 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:22:53 user nova-compute[75073]: DEBUG nova.objects.instance [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:22:53 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-616843a3-22cf-47cf-8d92-2151644bc1ea tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:22:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:22:59 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:22:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Cleaning up deleted instances {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 11:22:59 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] There are 0 instances to clean {{(pid=75073) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:23:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:07 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:23 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:23 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:23:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:23:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:23:24 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:23:24 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:23:25 user nova-compute[75073]: INFO nova.compute.manager [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attaching volume 5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 to /dev/vdb
Nov 24 11:23:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.utils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[453014ee-1479-4041-95d5-1aaf9c6f8efe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a980fc3f-32f0-4f75-8469-892c09f90bfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8ab94-5718-492d-af86-e46e2bd6b037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e3a09-9763-439d-8d7b-3f607e3f21b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:23:25 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:23:25 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[029079df-2196-4ef8-87b7-3704fb19841a]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG os_brick.utils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:23:25 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating existing volume attachment record: d239cd2a-14d6-4a06-a4c0-f042e4ae6df2 {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:23:28 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:28 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DduJHSFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:23:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:23:32 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:23:32 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[09349c2d-f6d8-4c85-9d91-639258c6afcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:23:32 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16be9ba-c877-4c82-8c8f-39de76cb9b43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3] added
Nov 24 11:23:32 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eebae20-5dae-4f86-beba-c2770553574f]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2254916b-0129-4d23-a93d-c8a161b6850a]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DduJHSFp {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DduJHSFp" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[220fcdf6-9536-4ee9-afa7-e3132b03f5b9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DduJHSFp'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40ed4be-9038-4a29-8b7f-2f66fd71231e]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a5676-9ef7-45a0-b91a-da85cb00c2a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:23:33 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:23:33 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:23:33 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:23:33 user nova-compute[75073]: 
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3faa09-7fef-43c6-8352-757e2ed72a43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260]
Nov 24 11:23:33 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260] successful.
Nov 24 11:23:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae747ef-0c6a-4be8-8fc8-4dbd6df30b2d]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[6937e85a-988f-4271-a076-b212692bf59e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)
Nov 24 11:23:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)
Nov 24 11:23:33 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b30929-3772-4b49-bd0d-d10c45213a5b]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DduJHSFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:33 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:23:33 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=25.084320068359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:23:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23931613562383761', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931613562383761', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.objects.instance [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:23:34 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:23:34 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:23:34 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:23:34 user nova-compute[75073]:   <serial>5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3</serial>
Nov 24 11:23:34 user nova-compute[75073]: </disk>
Nov 24 11:23:34 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No VIF found with MAC fa:16:3e:59:b7:0f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-b68f8bec-2574-4008-be19-cf322e173924 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.592s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:23:36 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:23:37 user nova-compute[75073]: INFO nova.compute.manager [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Detaching volume 5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3
Nov 24 11:23:37 user nova-compute[75073]: INFO nova.virt.block_device [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attempting to driver detach volume 5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 from mountpoint /dev/vdb
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Attempting to detach device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:23:37 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:23:37 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:23:37 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:23:37 user nova-compute[75073]:   <serial>5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3</serial>
Nov 24 11:23:37 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:23:37 user nova-compute[75073]: </disk>
Nov 24 11:23:37 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:23:37 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config.
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:23:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:23:37 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:23:37 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:23:37 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:23:37 user nova-compute[75073]:   <serial>5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3</serial>
Nov 24 11:23:37 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:23:37 user nova-compute[75073]: </disk>
Nov 24 11:23:37 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:23:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:23:38 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:23:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:23:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:23:58 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf is timed out.
Nov 24 11:23:58 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config.
Nov 24 11:23:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DduJHSFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:23:58 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[de50b3c6-2188-43db-bf1e-a2e5f7c32f2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:23:58 user nova-compute[75073]: No targets found.
Nov 24 11:23:58 user nova-compute[75073]: iSNS:
Nov 24 11:23:58 user nova-compute[75073]: No targets found.
Nov 24 11:23:58 user nova-compute[75073]: STATIC:
Nov 24 11:23:58 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3
Nov 24 11:23:58 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:23:58 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:23:58 user nova-compute[75073]: FIRMWARE:
Nov 24 11:23:58 user nova-compute[75073]: No targets found.
Nov 24 11:23:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:23:58 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:23:58 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe1a8fe-b7ae-46e4-9d03-3359e6165d7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec09b0-84e0-4296-a880-eee9682c9b10]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)
Nov 24 11:23:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 (non-flash)
Nov 24 11:23:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb2383f23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d2bb04-6c16-474d-9de7-a1995df06721]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a086f94-4889-4fd1-8026-0a7224228577]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[45262be5-6819-4092-9161-8ed71c28a4e4]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776fe44-9dc5-4ff9-8884-c987d8e32509]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db34518-0d9d-405d-879c-c7a403382404]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565863f-1e67-4744-ba17-2f07a6eb120c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260]
Nov 24 11:23:58 user nova-compute[75073]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3, portal: 172.16.0.220,3260] successful.
Nov 24 11:23:58 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf9aeab-e237-4dc4-a2d3-f15fa9e86dc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5666f77-9cb6-4f54-a570-410018aebb1c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== disconnect_volume: return (269ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:23:58 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:23:59 user nova-compute[75073]: DEBUG nova.objects.instance [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:23:59 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-318f5742-505e-48fb-b56d-ab50b1b29fb7 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:24:29 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:24:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:24:30 user nova-compute[75073]: DEBUG nova.objects.instance [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:24:30 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:24:31 user nova-compute[75073]: INFO nova.compute.manager [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attaching volume 067fb181-cb4f-45ee-a76e-3ab5b4713334 to /dev/vdb
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.utils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13dba83-12e2-4832-b2ff-b9e58a26de9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:9f29c3fd599\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e6d73-c54d-461f-9aca-b561a2b5e754]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3db6de-fa52-4e7f-9a48-0e4ecb5c2997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d81f2-b413-4bb5-8731-8642e72264a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Running cmd (subprocess): nvme version {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] 'nvme version' failed. Not Retrying. {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] nvme not present on system {{(pid=75073) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 11:24:31 user nova-compute[75073]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[34febd73-d16c-4961-96fc-d593cfc70e0a]: (4, '') {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75073) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.lightos [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] LIGHTOS: no hostnqn found. {{(pid=75073) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG os_brick.utils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:9f29c3fd599', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG nova.virt.block_device [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating existing volume attachment record: 1b83a7b7-16fe-4435-9e15-2db3e4309eba {{(pid=75073) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 11:24:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:24:32 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:33 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:24:33 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.08336639404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:24:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:24:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Calling os-brick to attach iSCSI Volume {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lirkgavM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:24:37 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:24:37 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:24:37 user nova-compute[75073]: INFO os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da0378-9f6d-4c74-8804-db3af0790ac1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 11:24:37 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --interface default --op new {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d4de08-a49a-4230-bcad-e9a1d1d8d73c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334] added\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334] added
Nov 24 11:24:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b85b4-7eed-44bd-8c68-86476b4e616c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc46d2-7cb5-4453-ab64-5b7ddb531fce]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lirkgavM {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lirkgavM" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b6822-4700-4936-8ce8-a5f5f255445b]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lirkgavM'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa95a73-1275-43c2-8bf1-c0b8b70fc6d9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c16113-e859-4f41-a981-e274cf87b3f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:24:37 user nova-compute[75073]:  {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 11:24:37 user nova-compute[75073]:  {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:24:37 user nova-compute[75073]: WARNING os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 11:24:37 user nova-compute[75073]: 
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --login {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8ac96-048a-4371-8b8d-a39d60b68e31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260]
Nov 24 11:24:37 user nova-compute[75073]: Login to [iface: default, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260] successful.
Nov 24 11:24:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5c919-d53f-44a4-b849-1144ff638b2c]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[915f0177-02c0-4641-9f3a-98304a13c15e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)
Nov 24 11:24:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)
Nov 24 11:24:37 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to 172.16.0.220:3260 {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75073) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75073) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7fa586-3ca9-422b-a188-92fafc3128fa]: (4, ('- - 0', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:24:37 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75073) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lirkgavM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75073) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26437663861333966', 'path': '/dev/sdb'} {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437663861333966', 'path': '/dev/sdb'} {{(pid=75073) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 11:24:38 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:24:38 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:24:38 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:24:38 user nova-compute[75073]:   <serial>067fb181-cb4f-45ee-a76e-3ab5b4713334</serial>
Nov 24 11:24:38 user nova-compute[75073]: </disk>
Nov 24 11:24:38 user nova-compute[75073]:  {{(pid=75073) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vda, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75073) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] No VIF found with MAC fa:16:3e:59:b7:0f, not building metadata {{(pid=75073) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:24:38 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cafff670-a8bd-4082-a3d4-83ae9a235d8d tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.863s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:24:39 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:24:39 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:24:39 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:24:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:24:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:24:41 user nova-compute[75073]: INFO nova.compute.manager [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Detaching volume 067fb181-cb4f-45ee-a76e-3ab5b4713334
Nov 24 11:24:41 user nova-compute[75073]: INFO nova.virt.block_device [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Attempting to driver detach volume 067fb181-cb4f-45ee-a76e-3ab5b4713334 from mountpoint /dev/vdb
Nov 24 11:24:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Attempting to detach device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config. {{(pid=75073) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 11:24:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:24:41 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:24:41 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:24:41 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:24:41 user nova-compute[75073]:   <serial>067fb181-cb4f-45ee-a76e-3ab5b4713334</serial>
Nov 24 11:24:41 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:24:41 user nova-compute[75073]: </disk>
Nov 24 11:24:41 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:24:41 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the persistent domain config.
Nov 24 11:24:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config. {{(pid=75073) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 11:24:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.guest [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 11:24:41 user nova-compute[75073]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 11:24:41 user nova-compute[75073]:   <source dev="/dev/sdb"/>
Nov 24 11:24:41 user nova-compute[75073]:   <target dev="vdb" bus="virtio"/>
Nov 24 11:24:41 user nova-compute[75073]:   <serial>067fb181-cb4f-45ee-a76e-3ab5b4713334</serial>
Nov 24 11:24:41 user nova-compute[75073]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 11:24:41 user nova-compute[75073]: </disk>
Nov 24 11:24:41 user nova-compute[75073]:  {{(pid=75073) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 11:24:41 user nova-compute[75073]: DEBUG nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 11:24:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:24:43 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:24:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:00 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:01 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf is timed out.
Nov 24 11:25:01 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully detached device vdb from instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf from the live domain config.
Nov 24 11:25:01 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] calling os-brick to detach iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb24045ff70>, {'target_iqn': 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lirkgavM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 11:25:01 user nova-compute[75073]: WARNING os_brick.initiator.connectors.base [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01e46c-e497-4ac1-9e4f-6c99f7c247d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 11:25:01 user nova-compute[75073]: No targets found.
Nov 24 11:25:01 user nova-compute[75073]: iSNS:
Nov 24 11:25:01 user nova-compute[75073]: No targets found.
Nov 24 11:25:01 user nova-compute[75073]: STATIC:
Nov 24 11:25:01 user nova-compute[75073]: Target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334
Nov 24 11:25:01 user nova-compute[75073]:         Portal: 172.16.0.220:3260,-1
Nov 24 11:25:01 user nova-compute[75073]:                 Iface Name: default
Nov 24 11:25:01 user nova-compute[75073]: FIRMWARE:
Nov 24 11:25:01 user nova-compute[75073]: No targets found.
Nov 24 11:25:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 11:25:01 user nova-compute[75073]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 11:25:01 user nova-compute[75073]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75073) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334', 0)] {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e4d2d-e5fb-4d6a-9662-be95d3d3fe0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526236e-bc48-417e-be3e-b2645529d528]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)
Nov 24 11:25:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 (non-flash)
Nov 24 11:25:01 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb23812c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334'): ({'sdb'}, set())}) {{(pid=75073) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Removing single pathed devices sdb {{(pid=75073) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[c658f5e4-69d7-4ede-a4e8-ffe2e5401c64]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c407bf-403c-42f7-97df-249148cd197c]: (4, ('ok\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Flushing IO for device /dev/sdb {{(pid=75073) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[56075db8-3e80-4929-aa44-74d9c56a81b9]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75073) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 11:25:01 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f12a24-20ab-4893-a8b4-56e16b8f54fe]: (4, ('1', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.linuxscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] SCSI volumes sdb have been removed. {{(pid=75073) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334')] {{(pid=75073) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98320f-1f7e-4314-a22a-6e6e9e0e4e69]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --logout {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a42d5-8b22-4814-ad0d-b2ce985b3a2f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260]
Nov 24 11:25:02 user nova-compute[75073]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334, portal: 172.16.0.220,3260] successful.
Nov 24 11:25:02 user nova-compute[75073]:  stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op delete {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:067fb181-cb4f-45ee-a76e-3ab5b4713334 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85267) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34d5b9-5e8d-4e74-b063-d521ee667987]: (4, ('', '')) {{(pid=85267) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75073) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.base [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] <== disconnect_volume: return (289ms) None {{(pid=75073) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Disconnected iSCSI Volume {{(pid=75073) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG nova.objects.instance [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'flavor' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:25:02 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-f9aa14d8-3e82-4feb-a040-9e6e97fa2c24 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:05 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:10 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:15 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:20 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:25:30 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:30 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:25:33 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.processutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75073) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 11:25:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:25:34 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.082523345947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75073) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:25:34 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:35 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquired lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Forcefully refreshing network info cache for instance {{(pid=75073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 11:25:40 user nova-compute[75073]: DEBUG nova.objects.instance [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lazy-loading 'info_cache' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:25:41 user nova-compute[75073]: DEBUG nova.network.neutron [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [{"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:25:41 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Releasing lock "refresh_cache-6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" {{(pid=75073) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 11:25:41 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updated the network info_cache for instance {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 11:25:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:45 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:47 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:25:50 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:55 user nova-compute[75073]: INFO nova.compute.manager [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Terminating instance
Nov 24 11:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Start destroying the instance on the hypervisor. {{(pid=75073) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-unplugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] No waiting events found dispatching network-vif-unplugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG nova.compute.manager [req-78891b3e-c8c7-48dd-8c4e-58d627ad70fd req-c8e404bc-e68b-44bc-8f26-cf30608b9298 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-unplugged-8f230c8c-b210-409f-a711-1291bfd7a91b for instance with task_state deleting. {{(pid=75073) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 11:25:55 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Instance destroyed successfully.
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.objects.instance [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lazy-loading 'resources' on Instance uuid 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf {{(pid=75073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.virt.libvirt.vif [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T11:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-351764608',display_name='tempest-SnapshotDataIntegrityTests-server-351764608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-351764608',id=53,image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjnIAq6bhWIxchNC/gzl2TXcxHih07VE0VFXpVVVjTyOnlltDF4VWoVoDP0HNLL6a7mo409Nd7a0iasQKzuovAW60kh1do7NrayB5zTiTqdH7x/2LvBBvdwkrCKFpPCXw==',key_name='tempest-keypair-797396173',keypairs=<?>,launch_index=0,launched_at=2023-11-24T11:19:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6effa9b0a3e4a12a92ba7c661a32e22',ramdisk_id='',reservation_id='r-numhke1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='095a7df6-bbc7-4ecc-bc96-7ae0d8ca4604',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-419032671',owner_user_name='tempest-SnapshotDataIntegrityTests-419032671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T11:19:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4ea89046fa04bd69fcd5dad85568842',uuid=6ecbf57f-cf07-41e8-8cdf-9e84733f32bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converting VIF {"id": "8f230c8c-b210-409f-a711-1291bfd7a91b", "address": "fa:16:3e:59:b7:0f", "network": {"id": "edfd0cad-4494-4a1c-a2d2-6b8bc418878c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-25215283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6effa9b0a3e4a12a92ba7c661a32e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f230c8c-b2", "ovs_interfaceid": "8f230c8c-b210-409f-a711-1291bfd7a91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.network.os_vif_util [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2') {{(pid=75073) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG os_vif [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2') {{(pid=75073) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f230c8c-b2, bridge=br-int, if_exists=True) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c2e249e-1d0f-4bd2-8fec-59e08184c0e6) {{(pid=75073) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:25:56 user nova-compute[75073]: INFO os_vif [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=8f230c8c-b210-409f-a711-1291bfd7a91b,network=Network(edfd0cad-4494-4a1c-a2d2-6b8bc418878c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f230c8c-b2')
Nov 24 11:25:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Deleting instance files /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf_del
Nov 24 11:25:56 user nova-compute[75073]: INFO nova.virt.libvirt.driver [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Deletion of /opt/stack/data/nova/instances/6ecbf57f-cf07-41e8-8cdf-9e84733f32bf_del complete
Nov 24 11:25:56 user nova-compute[75073]: INFO nova.compute.manager [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 24 11:25:56 user nova-compute[75073]: DEBUG oslo.service.loopingcall [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75073) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.compute.manager [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Deallocating network for instance {{(pid=75073) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] deallocate_for_instance() {{(pid=75073) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.network.neutron [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Updating instance_info_cache with network_info: [] {{(pid=75073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 11:25:56 user nova-compute[75073]: INFO nova.compute.manager [-] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Took 0.70 seconds to deallocate network for instance.
Nov 24 11:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:56 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:57 user nova-compute[75073]: INFO nova.scheduler.client.report [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Deleted allocations for instance 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf
Nov 24 11:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-cda3a454-dc6b-4c65-b50a-23096df460f8 tempest-SnapshotDataIntegrityTests-419032671 tempest-SnapshotDataIntegrityTests-419032671-project-member] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] Acquiring lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] Lock "6ecbf57f-cf07-41e8-8cdf-9e84733f32bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] No waiting events found dispatching network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 11:25:57 user nova-compute[75073]: WARNING nova.compute.manager [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received unexpected event network-vif-plugged-8f230c8c-b210-409f-a711-1291bfd7a91b for instance with vm_state deleted and task_state None.
Nov 24 11:25:57 user nova-compute[75073]: DEBUG nova.compute.manager [req-7a8709e8-f38b-4b8d-8f9e-9d9cd8c76134 req-2ffc34e2-a314-493c-8d11-d4fdb5c01ac3 service nova] [instance: 6ecbf57f-cf07-41e8-8cdf-9e84733f32bf] Received event network-vif-deleted-8f230c8c-b210-409f-a711-1291bfd7a91b {{(pid=75073) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 11:26:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:16 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:21 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:25 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:25 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75073) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 11:26:26 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:31 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:31 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:33 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:34 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:35 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:26:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:26:35 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:26:35 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Auditing locally available compute resources for user (node: user) {{(pid=75073) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:26:36 user nova-compute[75073]: WARNING nova.virt.libvirt.driver [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.109642028808594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75073) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75073) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.compute.provider_tree [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed in ProviderTree for provider: b8421a5b-83de-4630-bf28-983e95daab87 {{(pid=75073) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.scheduler.client.report [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Inventory has not changed for provider b8421a5b-83de-4630-bf28-983e95daab87 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75073) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG nova.compute.resource_tracker [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Compute_service record updated for user:user {{(pid=75073) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 11:26:36 user nova-compute[75073]: DEBUG oslo_concurrency.lockutils [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75073) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 11:26:37 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:41 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:42 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Starting heal instance info cache {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 11:26:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Rebuilding the list of instances to heal {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 11:26:42 user nova-compute[75073]: DEBUG nova.compute.manager [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Didn't find any instances for network info cache update. {{(pid=75073) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 11:26:43 user nova-compute[75073]: DEBUG oslo_service.periodic_task [None req-c5a426d6-a39d-4f42-a1db-770f26b30022 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75073) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:26:46 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:49 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:51 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:52 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:26:56 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75073) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75073) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 11:27:01 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:27:06 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 11:27:11 user nova-compute[75073]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75073) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}